data.table

Fast and Memory Efficient Data Manipulation


“Sometimes I’ll start a sentence and I don’t even know where it’s going. I just hope I find it along the way.”


“I am fast. To give you a reference point, I am somewhere between a snake and a mongoose… and a panther.”

Why data.table?

  1. Concise syntax: fast to type, fast to read – “Me think, why waste time say lot word when few word do trick.”
  1. Fast speed: optimized C code under the hood – “I am faster than 80 percent of all snakes.”
  1. Memory efficient: modify by reference – “Whenever I’m about to do something, I think, “would an idiot do that?” And if they would, I do not do that thing.”

Why data.table?

  1. Careful API lifecycle management: stable, backward compatible – “I’m not superstitious, but I am a little stitious.”
  1. Community: active development and support – “Would I rather be feared or loved? Easy. Both. I want people to be afraid of how much they love me.”
  1. Feature rich: comprehensive data manipulation toolkit – “Bears, beets, Battlestar Galactica.”

Data for Examples

Loading PUMS Data

Preview to next section with Jonathan about arrow:

library(data.table)
library(dplyr)
library(arrow)

# Preview into next section: Load multiple states and years using arrow
pums <- open_dataset(here::here("data/person")) |>
  filter(year >= 2020, location %in% c("ca", "tx", "ny")) |>
  collect()
setDT(pums)

Loading PUMS Data

pums[, 1:5]
         SPORDER            RT      SERIALNO   PUMA          ST
           <int>        <fctr>        <char> <char>      <char>
      1:       1 Person Record 2021HU0896827  00904 New York/NY
      2:       2 Person Record 2021HU0896827  00904 New York/NY
      3:       3 Person Record 2021HU0896827  00904 New York/NY
      4:       4 Person Record 2021HU0896827  00904 New York/NY
      5:       5 Person Record 2021HU0896827  00904 New York/NY
     ---                                                       
1735551:       1 Person Record 2022HU0609672  04611    Texas/TX
1735552:       2 Person Record 2022HU0609672  04611    Texas/TX
1735553:       3 Person Record 2022HU0609672  04611    Texas/TX
1735554:       1 Person Record 2022HU0609675  04302    Texas/TX
1735555:       2 Person Record 2022HU0609675  04302    Texas/TX
names(pums)
  [1] "SPORDER"   "RT"        "SERIALNO"  "PUMA"      "ST"        "ADJUST"   
  [7] "PWGTP"     "AGEP"      "CIT"       "COW"       "DDRS"      "DEYE"     
 [13] "DOUT"      "DPHY"      "DREM"      "DWRK"      "ENG"       "FER"      
 [19] "GCL"       "GCM"       "GCR"       "INTP"      "JWMNP"     "JWRIP"    
 [25] "JWTR"      "LANX"      "MAR"       "MIG"       "MIL"       "MILY"     
 [31] "MLPA"      "MLPB"      "MLPC"      "MLPD"      "MLPE"      "MLPF"     
 [37] "MLPG"      "MLPH"      "MLPI"      "MLPJ"      "MLPK"      "NWAB"     
 [43] "NWAV"      "NWLA"      "NWLK"      "NWRE"      "OIP"       "PAP"      
 [49] "REL"       "RETP"      "SCH"       "SCHG"      "SCHL"      "SEMP"     
 [55] "SEX"       "SSIP"      "SSP"       "WAGP"      "WKHP"      "WKL"      
 [61] "WKW"       "YOEP"      "UWRK"      "ANC"       "ANC1P"     "ANC2P"    
 [67] "DECADE"    "DRIVESP"   "DS"        "ESP"       "ESR"       "HISP"     
 [73] "INDP"      "JWAP"      "JWDP"      "LANP"      "MIGPUMA"   "MIGSP"    
 [79] "MSP"       "NAICSP"    "NATIVITY"  "OC"        "OCCP"      "PAOC"     
 [85] "PERNP"     "PINCP"     "POBP"      "POVPIP"    "POWPUMA"   "POWSP"    
 [91] "QTRBIR"    "RAC1P"     "RAC2P"     "RAC3P"     "RACAIAN"   "RACASN"   
 [97] "RACBLK"    "RACNHPI"   "RACNUM"    "RACSOR"    "RACWHT"    "RC"       
[103] "SFN"       "SFR"       "SOCP"      "VPS"       "WAOB"      "FAGEP"    
[109] "FANCP"     "FCITP"     "FCOWP"     "FDDRSP"    "FDEYEP"    "FDOUTP"   
[115] "FDPHYP"    "FDREMP"    "FDWRKP"    "FENGP"     "FESRP"     "FFERP"    
[121] "FGCLP"     "FGCMP"     "FGCRP"     "FHISP"     "FINDP"     "FINTP"    
[127] "FJWDP"     "FJWMNP"    "FJWRIP"    "FJWTRP"    "FLANP"     "FLANXP"   
[133] "FMARP"     "FMIGP"     "FMIGSP"    "FMILPP"    "FMILSP"    "FMILYP"   
[139] "FOCCP"     "FOIP"      "FPAP"      "FPOBP"     "FPOWSP"    "FRACP"    
[145] "FRELP"     "FRETP"     "FSCHGP"    "FSCHLP"    "FSCHP"     "FSEMP"    
[151] "FSEXP"     "FSSIP"     "FSSP"      "FWAGP"     "FWKHP"     "FWKLP"    
[157] "FWKWP"     "FYOEP"     "PWGTP1"    "PWGTP2"    "PWGTP3"    "PWGTP4"   
[163] "PWGTP5"    "PWGTP6"    "PWGTP7"    "PWGTP8"    "PWGTP9"    "PWGTP10"  
[169] "PWGTP11"   "PWGTP12"   "PWGTP13"   "PWGTP14"   "PWGTP15"   "PWGTP16"  
[175] "PWGTP17"   "PWGTP18"   "PWGTP19"   "PWGTP20"   "PWGTP21"   "PWGTP22"  
[181] "PWGTP23"   "PWGTP24"   "PWGTP25"   "PWGTP26"   "PWGTP27"   "PWGTP28"  
[187] "PWGTP29"   "PWGTP30"   "PWGTP31"   "PWGTP32"   "PWGTP33"   "PWGTP34"  
[193] "PWGTP35"   "PWGTP36"   "PWGTP37"   "PWGTP38"   "PWGTP39"   "PWGTP40"  
[199] "PWGTP41"   "PWGTP42"   "PWGTP43"   "PWGTP44"   "PWGTP45"   "PWGTP46"  
[205] "PWGTP47"   "PWGTP48"   "PWGTP49"   "PWGTP50"   "PWGTP51"   "PWGTP52"  
[211] "PWGTP53"   "PWGTP54"   "PWGTP55"   "PWGTP56"   "PWGTP57"   "PWGTP58"  
[217] "PWGTP59"   "PWGTP60"   "PWGTP61"   "PWGTP62"   "PWGTP63"   "PWGTP64"  
[223] "PWGTP65"   "PWGTP66"   "PWGTP67"   "PWGTP68"   "PWGTP69"   "PWGTP70"  
[229] "PWGTP71"   "PWGTP72"   "PWGTP73"   "PWGTP74"   "PWGTP75"   "PWGTP76"  
[235] "PWGTP77"   "PWGTP78"   "PWGTP79"   "PWGTP80"   "NOP"       "ADJINC"   
[241] "CITWP"     "DEAR"      "DRAT"      "DRATX"     "HINS1"     "HINS2"    
[247] "HINS3"     "HINS4"     "HINS5"     "HINS6"     "HINS7"     "MARHD"    
[253] "MARHM"     "MARHT"     "MARHW"     "MARHYP"    "DIS"       "HICOV"    
[259] "PRIVCOV"   "PUBCOV"    "FCITWP"    "FDEARP"    "FDRATP"    "FDRATXP"  
[265] "FHINS1P"   "FHINS2P"   "FHINS3P"   "FHINS4P"   "FHINS5P"   "FHINS6P"  
[271] "FHINS7P"   "FMARHDP"   "FMARHMP"   "FMARHTP"   "FMARHWP"   "FMARHYP"  
[277] "WRK"       "FOD1P"     "FOD2P"     "SCIENGP"   "SCIENGRLP" "FFODP"    
[283] "FHINS3C"   "FHINS4C"   "FHINS5C"   "RELP"      "FWRKP"     "FDISP"    
[289] "FPERNP"    "FPINCP"    "FPRIVCOVP" "FPUBCOVP"  "RACNH"     "RACPI"    
[295] "SSPA"      "MLPCD"     "MLPFG"     "FHICOVP"   "DIVISION"  "REGION"   
[301] "HIMRKS"    "JWTRNS"    "RELSHIPP"  "WKWN"      "FHIMRKSP"  "FJWTRNSP" 
[307] "FRELSHIPP" "FWKWNP"    "MLPIK"     "year"      "location"

1. Concise Syntax

“why waste time say lot word when few word do trick.”


1. Concise Syntax

Fast to type, fast to read

# Base R approach
pums_df <- as.data.frame(pums)
subset_data <- pums_df[pums$ST == "California/CA" & pums$year == 2022, ]
age_groups <- ifelse(subset_data$AGEP < 18, "Under 18",
                    ifelse(subset_data$AGEP < 65, "18-64", "65+"))
base_result <- aggregate(subset_data$PWGTP, by = list(age_group = age_groups), FUN = sum)

# data.table approach
pums[, age_groups := fcase(AGEP < 18, "Under 18", AGEP < 65, "18-64", default = "65+")]
dt_result <- pums[
  year == 2022 & ST == "California/CA", 
  .(total_pop = sum(PWGTP)), 
  by = age_groups
]
base_result
  age_group        x
1     18-64 24372342
2       65+  6165865
3  Under 18  8491135
dt_result
   age_groups total_pop
       <char>     <int>
1:      18-64  24372342
2:        65+   6165865
3:   Under 18   8491135

Fill in the Blank

We want to take the pums data.table and select the SCHL, SEX, ST, and AGEP.

dt_subset <- pums[,

]

Fill in the Blank

We want to take the pums data.table and select the SCHL, SEX, ST, and AGEP.

dt_subset <- pums[,
  .(SCHL, SEX, ST, AGEP)
]

Fill in the Blank

We want to subset to those in “ny” based on our location variable, group by age_groups and year, and get the proportion of those in the “Civilian employed, at work” based on the ESR variable.

dt_ny <- pums[



]

Fill in the Blank

We want to subset to those in “ny” based on our location variable, group by age_groups and year, and get the proportion of those in the “Civilian employed, at work” based on the ESR variable.

dt_ny <- pums[
  location == "ny",
  .(employed = mean(ESR == "Civilian employed, at work", na.rm = TRUE)),
  by = .(age_groups, year)
]

What will this do?

HINSx are insurance types WAGP income (wages/salary) last 12 months

pums[, ins_type := fcase(
  HINS1 == TRUE, "employer", 
  HINS2 == TRUE, "direct", 
  HINS3 == TRUE, "Medicare", 
  HINS4 == TRUE, "Medicaid",
  HINS5 == TRUE | HINS6 == TRUE | HINS7 == TRUE, "other",
  default = "no insurance")
]
pums[, .(avg_income = mean(WAGP, na.rm = TRUE)), by = ins_type]

What will this do?

HINSx are insurance types WAGP income (wages/salary) last 12 months

pums[, ins_type := fcase(
  HINS1 == TRUE, "employer", 
  HINS2 == TRUE, "direct", 
  HINS3 == TRUE, "Medicare", 
  HINS4 == TRUE, "Medicaid",
  HINS5 == TRUE | HINS6 == TRUE | HINS7 == TRUE, "other",
  default = "no insurance")
]
pums[, .(avg_income = mean(WAGP, na.rm = TRUE)), by = ins_type]
       ins_type avg_income
         <char>      <num>
1:       direct  20805.087
2:     employer  57418.563
3:     Medicare   6044.857
4:     Medicaid  10794.296
5: no insurance  18047.548
6:        other  30429.201

2. Fast Speed

“I am faster than 80 percent of all snakes.”

Benchmarking is difficult

# Benchmarking aggregation operations
microbenchmark::microbenchmark(
  # data.table
  pums[, .(total_pop = sum(PWGTP)), by = .(ST, year)],
  
  # dplyr
  pums_df |> 
    group_by(ST, year) |> 
    summarise(total_pop = sum(PWGTP), .groups = "drop"),

  times = 10
)
Unit: milliseconds
                                                                                  expr
                                   pums[, .(total_pop = sum(PWGTP)), by = .(ST, year)]
 summarise(group_by(pums_df, ST, year), total_pop = sum(PWGTP),      .groups = "drop")
      min       lq     mean   median       uq      max neval
 10.65586 10.86816 12.38742 11.24441 12.25334 18.80338    10
 22.14533 23.10104 26.42951 26.77839 27.52859 35.57590    10

2. Fast Speed

# Benchmarking aggregation operations
microbenchmark::microbenchmark(
  # data.table
  pums[, .(total_pop = sum(PWGTP)), keyby = .(ST, year)],
  
  # dplyr
  pums_df |> 
    group_by(ST, year) |> 
    summarise(total_pop = sum(PWGTP), .groups = "drop") |> 
    arrange(ST, year),

  times = 10
)
Unit: milliseconds
                                                                                                     expr
                                                   pums[, .(total_pop = sum(PWGTP)), keyby = .(ST, year)]
 arrange(summarise(group_by(pums_df, ST, year), total_pop = sum(PWGTP),      .groups = "drop"), ST, year)
      min       lq     mean   median       uq      max neval
 36.70439 37.05687 37.72736 37.47972 37.99835 40.02199    10
 20.80701 22.45783 25.46581 24.57036 27.08907 34.81310    10

3. Memory Efficient

“Whenever I’m about to do something, I think, “would an idiot do that?” And if they would, I do not do that thing.”


Quick History Lesson on Shallow/Deep Copies

# Create a copy (memory inefficient)
pums_nocopy <- pums

# Modify by reference (memory efficient)
pums[, age_decade := floor(AGEP / 10) * 10]

# shows up in pums_nocopy
pums_nocopy[, .(age_decade)]
         age_decade
              <num>
      1:         60
      2:         40
      3:         30
      4:         20
      5:         20
     ---           
1735551:         50
1735552:         60
1735553:         20
1735554:         60
1735555:         60
lobstr::ref(pums)
█ [1:0x10d207e00] <dt[,314]> 
├─SPORDER = [2:0x165f38000] <int> 
├─RT = [3:0x166c78000] <fct> 
├─SERIALNO = [4:0x10d800000] <chr> 
├─PUMA = [5:0x116800000] <chr> 
├─ST = [6:0x118280000] <chr> 
├─ADJUST = [7:0x147300000] <int> 
├─PWGTP = [8:0x3386a8000] <int> 
├─AGEP = [9:0x3393e8000] <int> 
├─CIT = [10:0x33a128000] <fct> 
├─COW = [11:0x33ae68000] <fct> 
├─DDRS = [12:0x140900000] <lgl> 
├─DEYE = [13:0x300018000] <lgl> 
├─DOUT = [14:0x3006b8000] <lgl> 
├─DPHY = [15:0x308008000] <lgl> 
├─DREM = [16:0x178140000] <lgl> 
├─DWRK = [17:0x1787e0000] <lgl> 
├─ENG = [18:0x33bba8000] <fct> 
├─FER = [19:0x120878000] <lgl> 
├─GCL = [20:0x161608000] <lgl> 
├─GCM = [21:0x33c8e8000] <fct> 
├─GCR = [22:0x140fa0000] <lgl> 
├─INTP = [23:0x33d628000] <int> 
├─JWMNP = [24:0x33e368000] <int> 
├─JWRIP = [25:0x11e200000] <chr> 
├─JWTR = [26:0x128000000] <chr> 
├─LANX = [27:0x141640000] <lgl> 
├─MAR = [28:0x33f0a8000] <fct> 
├─MIG = [29:0x141ce0000] <lgl> 
├─MIL = [30:0x340008000] <fct> 
├─MILY = [31:0x340d48000] <fct> 
├─MLPA = [32:0x310008000] <lgl> 
├─MLPB = [33:0x142380000] <lgl> 
├─MLPC = [34:0x142a20000] <lgl> 
├─MLPD = [35:0x318008000] <lgl> 
├─MLPE = [36:0x161ca8000] <lgl> 
├─MLPF = [37:0x162348000] <lgl> 
├─MLPG = [38:0x1629e8000] <lgl> 
├─MLPH = [39:0x1300c8000] <lgl> 
├─MLPI = [40:0x1430c0000] <lgl> 
├─MLPJ = [41:0x3186a8000] <lgl> 
├─MLPK = [42:0x318d48000] <lgl> 
├─NWAB = [43:0x3193e8000] <lgl> 
├─NWAV = [44:0x341a88000] <fct> 
├─NWLA = [45:0x319a88000] <lgl> 
├─NWLK = [46:0x31a128000] <lgl> 
├─NWRE = [47:0x120f18000] <lgl> 
├─OIP = [48:0x3427c8000] <int> 
├─PAP = [49:0x343508000] <int> 
├─REL = [50:0x12c000000] <chr> 
├─RETP = [51:0x303bb8000] <int> 
├─SCH = [52:0x1215b8000] <lgl> 
├─SCHG = [53:0x12da80000] <chr> 
├─SCHL = [54:0x138000000] <chr> 
├─SEMP = [55:0x330410000] <int> 
├─SEX = [56:0x331150000] <fct> 
├─SSIP = [57:0x331e90000] <int> 
├─SSP = [58:0x332bd0000] <int> 
├─WAGP = [59:0x333910000] <int> 
├─WKHP = [60:0x334650000] <int> 
├─WKL = [61:0x335390000] <fct> 
├─WKW = [62:0x3360d0000] <fct> 
├─YOEP = [63:0x13b800000] <chr> 
├─UWRK = [64:0x121c58000] <lgl> 
├─ANC = [65:0x336e10000] <fct> 
├─ANC1P = [66:0x13d280000] <chr> 
├─ANC2P = [67:0x13ed00000] <chr> 
├─DECADE = [68:0x344248000] <fct> 
├─DRIVESP = [69:0x344f88000] <fct> 
├─DS = [70:0x1222f8000] <lgl> 
├─ESP = [71:0x345cc8000] <fct> 
├─ESR = [72:0x346a08000] <fct> 
├─HISP = [73:0x148d40000] <chr> 
├─INDP = [74:0x14dd40000] <chr> 
├─JWAP = [75:0x158000000] <chr> 
├─JWDP = [76:0x15b800000] <chr> 
├─LANP = [77:0x15d280000] <chr> 
├─MIGPUMA = [78:0x156298000] <fct> 
├─MIGSP = [79:0x15ed00000] <chr> 
├─MSP = [80:0x126bd8000] <fct> 
├─NAICSP = [81:0x168d40000] <chr> 
├─NATIVITY = [82:0x127918000] <fct> 
├─OC = [83:0x178e80000] <lgl> 
├─OCCP = [84:0x16a7c0000] <chr> 
├─PAOC = [85:0x3486a8000] <fct> 
├─PERNP = [86:0x3493e8000] <int> 
├─PINCP = [87:0x34a128000] <int> 
├─POBP = [88:0x1711a0000] <chr> 
├─POVPIP = [89:0x34ae68000] <int> 
├─POWPUMA = [90:0x34bba8000] <fct> 
├─POWSP = [91:0x172c20000] <chr> 
├─QTRBIR = [92:0x34c8e8000] <fct> 
├─RAC1P = [93:0x34d628000] <fct> 
├─RAC2P = [94:0x1746a0000] <chr> 
├─RAC3P = [95:0x176120000] <chr> 
├─RACAIAN = [96:0x122998000] <lgl> 
├─RACASN = [97:0x320008000] <lgl> 
├─RACBLK = [98:0x130768000] <lgl> 
├─RACNHPI = [99:0x3206a8000] <lgl> 
├─RACNUM = [100:0x34e368000] <int> 
├─RACSOR = [101:0x163088000] <lgl> 
├─RACWHT = [102:0x3086a8000] <lgl> 
├─RC = [103:0x31a7c8000] <lgl> 
├─SFN = [104:0x34f0a8000] <fct> 
├─SFR = [105:0x350008000] <fct> 
├─SOCP = [106:0x358000000] <chr> 
├─VPS = [107:0x359a80000] <chr> 
├─WAOB = [108:0x350d48000] <fct> 
├─FAGEP = [109:0x150c78000] <lgl> 
├─FANCP = [110:0x143760000] <lgl> 
├─FCITP = [111:0x320d48000] <lgl> 
├─FCOWP = [112:0x300d58000] <lgl> 
├─FDDRSP = [113:0x130e08000] <lgl> 
├─FDEYEP = [114:0x179520000] <lgl> 
├─FDOUTP = [115:0x179bc0000] <lgl> 
├─FDPHYP = [116:0x151318000] <lgl> 
├─FDREMP = [117:0x3106a8000] <lgl> 
├─FDWRKP = [118:0x17a260000] <lgl> 
├─FENGP = [119:0x17a900000] <lgl> 
├─FESRP = [120:0x17afa0000] <lgl> 
├─FFERP = [121:0x123038000] <lgl> 
├─FGCLP = [122:0x1236d8000] <lgl> 
├─FGCMP = [123:0x1519b8000] <lgl> 
├─FGCRP = [124:0x3213e8000] <lgl> 
├─FHISP = [125:0x123d78000] <lgl> 
├─FINDP = [126:0x124418000] <lgl> 
├─FINTP = [127:0x124ab8000] <lgl> 
├─FJWDP = [128:0x163728000] <lgl> 
├─FJWMNP = [129:0x321a88000] <lgl> 
├─FJWRIP = [130:0x310d48000] <lgl> 
├─FJWTRP = [131:0x31ae68000] <lgl> 
├─FLANP = [132:0x31b508000] <lgl> 
├─FLANXP = [133:0x308d48000] <lgl> 
├─FMARP = [134:0x3013f8000] <lgl> 
├─FMIGP = [135:0x301a98000] <lgl> 
├─FMIGSP = [136:0x322128000] <lgl> 
├─FMILPP = [137:0x17b640000] <lgl> 
├─FMILSP = [138:0x17bce0000] <lgl> 
├─FMILYP = [139:0x3093e8000] <lgl> 
├─FOCCP = [140:0x309a88000] <lgl> 
├─FOIP = [141:0x30a128000] <lgl> 
├─FPAP = [142:0x143e00000] <lgl> 
├─FPOBP = [143:0x1444a0000] <lgl> 
├─FPOWSP = [144:0x125158000] <lgl> 
├─FRACP = [145:0x1257f8000] <lgl> 
├─FRELP = [146:0x17c380000] <lgl> 
├─FRETP = [147:0x152058000] <lgl> 
├─FSCHGP = [148:0x1526f8000] <lgl> 
├─FSCHLP = [149:0x152d98000] <lgl> 
├─FSCHP = [150:0x163dc8000] <lgl> 
├─FSEMP = [151:0x144b40000] <lgl> 
├─FSEXP = [152:0x1451e0000] <lgl> 
├─FSSIP = [153:0x302138000] <lgl> 
├─FSSP = [154:0x3027d8000] <lgl> 
├─FWAGP = [155:0x302e78000] <lgl> 
├─FWKHP = [156:0x303518000] <lgl> 
├─FWKLP = [157:0x30a7c8000] <lgl> 
├─FWKWP = [158:0x30ae68000] <lgl> 
├─FYOEP = [159:0x17ca20000] <lgl> 
├─PWGTP1 = [160:0x351a88000] <int> 
├─PWGTP2 = [161:0x3527c8000] <int> 
├─PWGTP3 = [162:0x353508000] <int> 
├─PWGTP4 = [163:0x354248000] <int> 
├─PWGTP5 = [164:0x354f88000] <int> 
├─PWGTP6 = [165:0x1321e8000] <int> 
├─PWGTP7 = [166:0x360008000] <int> 
├─PWGTP8 = [167:0x360d48000] <int> 
├─PWGTP9 = [168:0x361a88000] <int> 
├─PWGTP10 = [169:0x3627c8000] <int> 
├─PWGTP11 = [170:0x363508000] <int> 
├─PWGTP12 = [171:0x364248000] <int> 
├─PWGTP13 = [172:0x347748000] <int> 
├─PWGTP14 = [173:0x3686a8000] <int> 
├─PWGTP15 = [174:0x3693e8000] <int> 
├─PWGTP16 = [175:0x355cc8000] <int> 
├─PWGTP17 = [176:0x36a128000] <int> 
├─PWGTP18 = [177:0x36ae68000] <int> 
├─PWGTP19 = [178:0x36bba8000] <int> 
├─PWGTP20 = [179:0x36c8e8000] <int> 
├─PWGTP21 = [180:0x156fd8000] <int> 
├─PWGTP22 = [181:0x370008000] <int> 
├─PWGTP23 = [182:0x370d48000] <int> 
├─PWGTP24 = [183:0x371a88000] <int> 
├─PWGTP25 = [184:0x3727c8000] <int> 
├─PWGTP26 = [185:0x364f88000] <int> 
├─PWGTP27 = [186:0x365cc8000] <int> 
├─PWGTP28 = [187:0x366a08000] <int> 
├─PWGTP29 = [188:0x367748000] <int> 
├─PWGTP30 = [189:0x3786a8000] <int> 
├─PWGTP31 = [190:0x3793e8000] <int> 
├─PWGTP32 = [191:0x37a128000] <int> 
├─PWGTP33 = [192:0x37ae68000] <int> 
├─PWGTP34 = [193:0x37bba8000] <int> 
├─PWGTP35 = [194:0x37c8e8000] <int> 
├─PWGTP36 = [195:0x37d628000] <int> 
├─PWGTP37 = [196:0x37e368000] <int> 
├─PWGTP38 = [197:0x37f0a8000] <int> 
├─PWGTP39 = [198:0x380008000] <int> 
├─PWGTP40 = [199:0x36d628000] <int> 
├─PWGTP41 = [200:0x36e368000] <int> 
├─PWGTP42 = [201:0x373508000] <int> 
├─PWGTP43 = [202:0x374248000] <int> 
├─PWGTP44 = [203:0x380d48000] <int> 
├─PWGTP45 = [204:0x381a88000] <int> 
├─PWGTP46 = [205:0x3827c8000] <int> 
├─PWGTP47 = [206:0x383508000] <int> 
├─PWGTP48 = [207:0x384248000] <int> 
├─PWGTP49 = [208:0x384f88000] <int> 
├─PWGTP50 = [209:0x385cc8000] <int> 
├─PWGTP51 = [210:0x386a08000] <int> 
├─PWGTP52 = [211:0x387748000] <int> 
├─PWGTP53 = [212:0x356a08000] <int> 
├─PWGTP54 = [213:0x357748000] <int> 
├─PWGTP55 = [214:0x3906a8000] <int> 
├─PWGTP56 = [215:0x3913e8000] <int> 
├─PWGTP57 = [216:0x392128000] <int> 
├─PWGTP58 = [217:0x392e68000] <int> 
├─PWGTP59 = [218:0x393ba8000] <int> 
├─PWGTP60 = [219:0x3948e8000] <int> 
├─PWGTP61 = [220:0x395628000] <int> 
├─PWGTP62 = [221:0x396368000] <int> 
├─PWGTP63 = [222:0x3970a8000] <int> 
├─PWGTP64 = [223:0x398008000] <int> 
├─PWGTP65 = [224:0x398d48000] <int> 
├─PWGTP66 = [225:0x399a88000] <int> 
├─PWGTP67 = [226:0x39a7c8000] <int> 
├─PWGTP68 = [227:0x39b508000] <int> 
├─PWGTP69 = [228:0x39c248000] <int> 
├─PWGTP70 = [229:0x39cf88000] <int> 
├─PWGTP71 = [230:0x39dcc8000] <int> 
├─PWGTP72 = [231:0x39ea08000] <int> 
├─PWGTP73 = [232:0x39f748000] <int> 
├─PWGTP74 = [233:0x3a06a8000] <int> 
├─PWGTP75 = [234:0x374f88000] <int> 
├─PWGTP76 = [235:0x36f0a8000] <int> 
├─PWGTP77 = [236:0x3a8008000] <int> 
├─PWGTP78 = [237:0x3a8d48000] <int> 
├─PWGTP79 = [238:0x3a9a88000] <int> 
├─PWGTP80 = [239:0x3aa7c8000] <int> 
├─NOP = [240:0x3ab508000] <fct> 
├─ADJINC = [241:0x35b500000] <dbl> 
├─CITWP = [242:0x35cf80000] <chr> 
├─DEAR = [243:0x31bba8000] <lgl> 
├─DRAT = [244:0x3886a8000] <fct> 
├─DRATX = [245:0x153438000] <lgl> 
├─HINS1 = [246:0x153ad8000] <lgl> 
├─HINS2 = [247:0x145880000] <lgl> 
├─HINS3 = [248:0x145f20000] <lgl> 
├─HINS4 = [249:0x1465c0000] <lgl> 
├─HINS5 = [250:0x31c248000] <lgl> 
├─HINS6 = [251:0x31c8e8000] <lgl> 
├─HINS7 = [252:0x164468000] <lgl> 
├─MARHD = [253:0x164b08000] <lgl> 
├─MARHM = [254:0x1314a8000] <lgl> 
├─MARHT = [255:0x3893e8000] <fct> 
├─MARHW = [256:0x125e98000] <lgl> 
├─MARHYP = [257:0x35ea00000] <chr> 
├─DIS = [258:0x154178000] <lgl> 
├─HICOV = [259:0x1651a8000] <lgl> 
├─PRIVCOV = [260:0x165848000] <lgl> 
├─PUBCOV = [261:0x3227c8000] <lgl> 
├─FCITWP = [262:0x154818000] <lgl> 
├─FDEARP = [263:0x322e68000] <lgl> 
├─FDRATP = [264:0x323508000] <lgl> 
├─FDRATXP = [265:0x17d0c0000] <lgl> 
├─FHINS1P = [266:0x17d760000] <lgl> 
├─FHINS2P = [267:0x328008000] <lgl> 
├─FHINS3P = [268:0x154eb8000] <lgl> 
├─FHINS4P = [269:0x155558000] <lgl> 
├─FHINS5P = [270:0x30b508000] <lgl> 
├─FHINS6P = [271:0x31cf88000] <lgl> 
├─FHINS7P = [272:0x3113e8000] <lgl> 
├─FMARHDP = [273:0x3286a8000] <lgl> 
├─FMARHMP = [274:0x328d48000] <lgl> 
├─FMARHTP = [275:0x323ba8000] <lgl> 
├─FMARHWP = [276:0x324248000] <lgl> 
├─FMARHYP = [277:0x3248e8000] <lgl> 
├─WRK = [278:0x146c60000] <lgl> 
├─FOD1P = [279:0x3b0d40000] <chr> 
├─FOD2P = [280:0x3b27c0000] <chr> 
├─SCIENGP = [281:0x311a88000] <lgl> 
├─SCIENGRLP = [282:0x17de00000] <lgl> 
├─FFODP = [283:0x30bba8000] <lgl> 
├─FHINS3C = [284:0x38a128000] <fct> 
├─FHINS4C = [285:0x38ae68000] <fct> 
├─FHINS5C = [286:0x38bba8000] <fct> 
├─RELP = [287:0x3b4240000] <chr> 
├─FWRKP = [288:0x17e4a0000] <lgl> 
├─FDISP = [289:0x17eb40000] <lgl> 
├─FPERNP = [290:0x17f1e0000] <lgl> 
├─FPINCP = [291:0x31d628000] <lgl> 
├─FPRIVCOVP = [292:0x31dcc8000] <lgl> 
├─FPUBCOVP = [293:0x31e368000] <lgl> 
├─RACNH = [294:0x126538000] <lgl> 
├─RACPI = [295:0x3293e8000] <lgl> 
├─SSPA = [296:0x38c8e8000] <fct> 
├─MLPCD = [297:0x329a88000] <lgl> 
├─MLPFG = [298:0x32a128000] <lgl> 
├─FHICOVP = [299:0x32a7c8000] <lgl> 
├─DIVISION = [300:0x38d628000] <fct> 
├─REGION = [301:0x38e368000] <fct> 
├─HIMRKS = [302:0x38f0a8000] <fct> 
├─JWTRNS = [303:0x3b5cc0000] <chr> 
├─RELSHIPP = [304:0x3b7740000] <chr> 
├─WKWN = [305:0x132f28000] <int> 
├─FHIMRKSP = [306:0x131b48000] <lgl> 
├─FJWTRNSP = [307:0x155bf8000] <lgl> 
├─FRELSHIPP = [308:0x32ae68000] <lgl> 
├─FWKWNP = [309:0x32b508000] <lgl> 
├─MLPIK = [310:0x32bba8000] <lgl> 
├─year = [311:0x133c68000] <int> 
├─location = [312:0x3b91c0000] <chr> 
├─age_groups = [313:0x15c540000] <chr> 
├─ins_type = [314:0x15dfc0000] <chr> 
└─age_decade = [315:0x35dcc0000] <dbl> 
lobstr::ref(pums_nocopy)
█ [1:0x10d207e00] <dt[,314]> 
├─SPORDER = [2:0x165f38000] <int> 
├─RT = [3:0x166c78000] <fct> 
├─SERIALNO = [4:0x10d800000] <chr> 
├─PUMA = [5:0x116800000] <chr> 
├─ST = [6:0x118280000] <chr> 
├─ADJUST = [7:0x147300000] <int> 
├─PWGTP = [8:0x3386a8000] <int> 
├─AGEP = [9:0x3393e8000] <int> 
├─CIT = [10:0x33a128000] <fct> 
├─COW = [11:0x33ae68000] <fct> 
├─DDRS = [12:0x140900000] <lgl> 
├─DEYE = [13:0x300018000] <lgl> 
├─DOUT = [14:0x3006b8000] <lgl> 
├─DPHY = [15:0x308008000] <lgl> 
├─DREM = [16:0x178140000] <lgl> 
├─DWRK = [17:0x1787e0000] <lgl> 
├─ENG = [18:0x33bba8000] <fct> 
├─FER = [19:0x120878000] <lgl> 
├─GCL = [20:0x161608000] <lgl> 
├─GCM = [21:0x33c8e8000] <fct> 
├─GCR = [22:0x140fa0000] <lgl> 
├─INTP = [23:0x33d628000] <int> 
├─JWMNP = [24:0x33e368000] <int> 
├─JWRIP = [25:0x11e200000] <chr> 
├─JWTR = [26:0x128000000] <chr> 
├─LANX = [27:0x141640000] <lgl> 
├─MAR = [28:0x33f0a8000] <fct> 
├─MIG = [29:0x141ce0000] <lgl> 
├─MIL = [30:0x340008000] <fct> 
├─MILY = [31:0x340d48000] <fct> 
├─MLPA = [32:0x310008000] <lgl> 
├─MLPB = [33:0x142380000] <lgl> 
├─MLPC = [34:0x142a20000] <lgl> 
├─MLPD = [35:0x318008000] <lgl> 
├─MLPE = [36:0x161ca8000] <lgl> 
├─MLPF = [37:0x162348000] <lgl> 
├─MLPG = [38:0x1629e8000] <lgl> 
├─MLPH = [39:0x1300c8000] <lgl> 
├─MLPI = [40:0x1430c0000] <lgl> 
├─MLPJ = [41:0x3186a8000] <lgl> 
├─MLPK = [42:0x318d48000] <lgl> 
├─NWAB = [43:0x3193e8000] <lgl> 
├─NWAV = [44:0x341a88000] <fct> 
├─NWLA = [45:0x319a88000] <lgl> 
├─NWLK = [46:0x31a128000] <lgl> 
├─NWRE = [47:0x120f18000] <lgl> 
├─OIP = [48:0x3427c8000] <int> 
├─PAP = [49:0x343508000] <int> 
├─REL = [50:0x12c000000] <chr> 
├─RETP = [51:0x303bb8000] <int> 
├─SCH = [52:0x1215b8000] <lgl> 
├─SCHG = [53:0x12da80000] <chr> 
├─SCHL = [54:0x138000000] <chr> 
├─SEMP = [55:0x330410000] <int> 
├─SEX = [56:0x331150000] <fct> 
├─SSIP = [57:0x331e90000] <int> 
├─SSP = [58:0x332bd0000] <int> 
├─WAGP = [59:0x333910000] <int> 
├─WKHP = [60:0x334650000] <int> 
├─WKL = [61:0x335390000] <fct> 
├─WKW = [62:0x3360d0000] <fct> 
├─YOEP = [63:0x13b800000] <chr> 
├─UWRK = [64:0x121c58000] <lgl> 
├─ANC = [65:0x336e10000] <fct> 
├─ANC1P = [66:0x13d280000] <chr> 
├─ANC2P = [67:0x13ed00000] <chr> 
├─DECADE = [68:0x344248000] <fct> 
├─DRIVESP = [69:0x344f88000] <fct> 
├─DS = [70:0x1222f8000] <lgl> 
├─ESP = [71:0x345cc8000] <fct> 
├─ESR = [72:0x346a08000] <fct> 
├─HISP = [73:0x148d40000] <chr> 
├─INDP = [74:0x14dd40000] <chr> 
├─JWAP = [75:0x158000000] <chr> 
├─JWDP = [76:0x15b800000] <chr> 
├─LANP = [77:0x15d280000] <chr> 
├─MIGPUMA = [78:0x156298000] <fct> 
├─MIGSP = [79:0x15ed00000] <chr> 
├─MSP = [80:0x126bd8000] <fct> 
├─NAICSP = [81:0x168d40000] <chr> 
├─NATIVITY = [82:0x127918000] <fct> 
├─OC = [83:0x178e80000] <lgl> 
├─OCCP = [84:0x16a7c0000] <chr> 
├─PAOC = [85:0x3486a8000] <fct> 
├─PERNP = [86:0x3493e8000] <int> 
├─PINCP = [87:0x34a128000] <int> 
├─POBP = [88:0x1711a0000] <chr> 
├─POVPIP = [89:0x34ae68000] <int> 
├─POWPUMA = [90:0x34bba8000] <fct> 
├─POWSP = [91:0x172c20000] <chr> 
├─QTRBIR = [92:0x34c8e8000] <fct> 
├─RAC1P = [93:0x34d628000] <fct> 
├─RAC2P = [94:0x1746a0000] <chr> 
├─RAC3P = [95:0x176120000] <chr> 
├─RACAIAN = [96:0x122998000] <lgl> 
├─RACASN = [97:0x320008000] <lgl> 
├─RACBLK = [98:0x130768000] <lgl> 
├─RACNHPI = [99:0x3206a8000] <lgl> 
├─RACNUM = [100:0x34e368000] <int> 
├─RACSOR = [101:0x163088000] <lgl> 
├─RACWHT = [102:0x3086a8000] <lgl> 
├─RC = [103:0x31a7c8000] <lgl> 
├─SFN = [104:0x34f0a8000] <fct> 
├─SFR = [105:0x350008000] <fct> 
├─SOCP = [106:0x358000000] <chr> 
├─VPS = [107:0x359a80000] <chr> 
├─WAOB = [108:0x350d48000] <fct> 
├─FAGEP = [109:0x150c78000] <lgl> 
├─FANCP = [110:0x143760000] <lgl> 
├─FCITP = [111:0x320d48000] <lgl> 
├─FCOWP = [112:0x300d58000] <lgl> 
├─FDDRSP = [113:0x130e08000] <lgl> 
├─FDEYEP = [114:0x179520000] <lgl> 
├─FDOUTP = [115:0x179bc0000] <lgl> 
├─FDPHYP = [116:0x151318000] <lgl> 
├─FDREMP = [117:0x3106a8000] <lgl> 
├─FDWRKP = [118:0x17a260000] <lgl> 
├─FENGP = [119:0x17a900000] <lgl> 
├─FESRP = [120:0x17afa0000] <lgl> 
├─FFERP = [121:0x123038000] <lgl> 
├─FGCLP = [122:0x1236d8000] <lgl> 
├─FGCMP = [123:0x1519b8000] <lgl> 
├─FGCRP = [124:0x3213e8000] <lgl> 
├─FHISP = [125:0x123d78000] <lgl> 
├─FINDP = [126:0x124418000] <lgl> 
├─FINTP = [127:0x124ab8000] <lgl> 
├─FJWDP = [128:0x163728000] <lgl> 
├─FJWMNP = [129:0x321a88000] <lgl> 
├─FJWRIP = [130:0x310d48000] <lgl> 
├─FJWTRP = [131:0x31ae68000] <lgl> 
├─FLANP = [132:0x31b508000] <lgl> 
├─FLANXP = [133:0x308d48000] <lgl> 
├─FMARP = [134:0x3013f8000] <lgl> 
├─FMIGP = [135:0x301a98000] <lgl> 
├─FMIGSP = [136:0x322128000] <lgl> 
├─FMILPP = [137:0x17b640000] <lgl> 
├─FMILSP = [138:0x17bce0000] <lgl> 
├─FMILYP = [139:0x3093e8000] <lgl> 
├─FOCCP = [140:0x309a88000] <lgl> 
├─FOIP = [141:0x30a128000] <lgl> 
├─FPAP = [142:0x143e00000] <lgl> 
├─FPOBP = [143:0x1444a0000] <lgl> 
├─FPOWSP = [144:0x125158000] <lgl> 
├─FRACP = [145:0x1257f8000] <lgl> 
├─FRELP = [146:0x17c380000] <lgl> 
├─FRETP = [147:0x152058000] <lgl> 
├─FSCHGP = [148:0x1526f8000] <lgl> 
├─FSCHLP = [149:0x152d98000] <lgl> 
├─FSCHP = [150:0x163dc8000] <lgl> 
├─FSEMP = [151:0x144b40000] <lgl> 
├─FSEXP = [152:0x1451e0000] <lgl> 
├─FSSIP = [153:0x302138000] <lgl> 
├─FSSP = [154:0x3027d8000] <lgl> 
├─FWAGP = [155:0x302e78000] <lgl> 
├─FWKHP = [156:0x303518000] <lgl> 
├─FWKLP = [157:0x30a7c8000] <lgl> 
├─FWKWP = [158:0x30ae68000] <lgl> 
├─FYOEP = [159:0x17ca20000] <lgl> 
├─PWGTP1 = [160:0x351a88000] <int> 
├─PWGTP2 = [161:0x3527c8000] <int> 
├─PWGTP3 = [162:0x353508000] <int> 
├─PWGTP4 = [163:0x354248000] <int> 
├─PWGTP5 = [164:0x354f88000] <int> 
├─PWGTP6 = [165:0x1321e8000] <int> 
├─PWGTP7 = [166:0x360008000] <int> 
├─PWGTP8 = [167:0x360d48000] <int> 
├─PWGTP9 = [168:0x361a88000] <int> 
├─PWGTP10 = [169:0x3627c8000] <int> 
├─PWGTP11 = [170:0x363508000] <int> 
├─PWGTP12 = [171:0x364248000] <int> 
├─PWGTP13 = [172:0x347748000] <int> 
├─PWGTP14 = [173:0x3686a8000] <int> 
├─PWGTP15 = [174:0x3693e8000] <int> 
├─PWGTP16 = [175:0x355cc8000] <int> 
├─PWGTP17 = [176:0x36a128000] <int> 
├─PWGTP18 = [177:0x36ae68000] <int> 
├─PWGTP19 = [178:0x36bba8000] <int> 
├─PWGTP20 = [179:0x36c8e8000] <int> 
├─PWGTP21 = [180:0x156fd8000] <int> 
├─PWGTP22 = [181:0x370008000] <int> 
├─PWGTP23 = [182:0x370d48000] <int> 
├─PWGTP24 = [183:0x371a88000] <int> 
├─PWGTP25 = [184:0x3727c8000] <int> 
├─PWGTP26 = [185:0x364f88000] <int> 
├─PWGTP27 = [186:0x365cc8000] <int> 
├─PWGTP28 = [187:0x366a08000] <int> 
├─PWGTP29 = [188:0x367748000] <int> 
├─PWGTP30 = [189:0x3786a8000] <int> 
├─PWGTP31 = [190:0x3793e8000] <int> 
├─PWGTP32 = [191:0x37a128000] <int> 
├─PWGTP33 = [192:0x37ae68000] <int> 
├─PWGTP34 = [193:0x37bba8000] <int> 
├─PWGTP35 = [194:0x37c8e8000] <int> 
├─PWGTP36 = [195:0x37d628000] <int> 
├─PWGTP37 = [196:0x37e368000] <int> 
├─PWGTP38 = [197:0x37f0a8000] <int> 
├─PWGTP39 = [198:0x380008000] <int> 
├─PWGTP40 = [199:0x36d628000] <int> 
├─PWGTP41 = [200:0x36e368000] <int> 
├─PWGTP42 = [201:0x373508000] <int> 
├─PWGTP43 = [202:0x374248000] <int> 
├─PWGTP44 = [203:0x380d48000] <int> 
├─PWGTP45 = [204:0x381a88000] <int> 
├─PWGTP46 = [205:0x3827c8000] <int> 
├─PWGTP47 = [206:0x383508000] <int> 
├─PWGTP48 = [207:0x384248000] <int> 
├─PWGTP49 = [208:0x384f88000] <int> 
├─PWGTP50 = [209:0x385cc8000] <int> 
├─PWGTP51 = [210:0x386a08000] <int> 
├─PWGTP52 = [211:0x387748000] <int> 
├─PWGTP53 = [212:0x356a08000] <int> 
├─PWGTP54 = [213:0x357748000] <int> 
├─PWGTP55 = [214:0x3906a8000] <int> 
├─PWGTP56 = [215:0x3913e8000] <int> 
├─PWGTP57 = [216:0x392128000] <int> 
├─PWGTP58 = [217:0x392e68000] <int> 
├─PWGTP59 = [218:0x393ba8000] <int> 
├─PWGTP60 = [219:0x3948e8000] <int> 
├─PWGTP61 = [220:0x395628000] <int> 
├─PWGTP62 = [221:0x396368000] <int> 
├─PWGTP63 = [222:0x3970a8000] <int> 
├─PWGTP64 = [223:0x398008000] <int> 
├─PWGTP65 = [224:0x398d48000] <int> 
├─PWGTP66 = [225:0x399a88000] <int> 
├─PWGTP67 = [226:0x39a7c8000] <int> 
├─PWGTP68 = [227:0x39b508000] <int> 
├─PWGTP69 = [228:0x39c248000] <int> 
├─PWGTP70 = [229:0x39cf88000] <int> 
├─PWGTP71 = [230:0x39dcc8000] <int> 
├─PWGTP72 = [231:0x39ea08000] <int> 
├─PWGTP73 = [232:0x39f748000] <int> 
├─PWGTP74 = [233:0x3a06a8000] <int> 
├─PWGTP75 = [234:0x374f88000] <int> 
├─PWGTP76 = [235:0x36f0a8000] <int> 
├─PWGTP77 = [236:0x3a8008000] <int> 
├─PWGTP78 = [237:0x3a8d48000] <int> 
├─PWGTP79 = [238:0x3a9a88000] <int> 
├─PWGTP80 = [239:0x3aa7c8000] <int> 
├─NOP = [240:0x3ab508000] <fct> 
├─ADJINC = [241:0x35b500000] <dbl> 
├─CITWP = [242:0x35cf80000] <chr> 
├─DEAR = [243:0x31bba8000] <lgl> 
├─DRAT = [244:0x3886a8000] <fct> 
├─DRATX = [245:0x153438000] <lgl> 
├─HINS1 = [246:0x153ad8000] <lgl> 
├─HINS2 = [247:0x145880000] <lgl> 
├─HINS3 = [248:0x145f20000] <lgl> 
├─HINS4 = [249:0x1465c0000] <lgl> 
├─HINS5 = [250:0x31c248000] <lgl> 
├─HINS6 = [251:0x31c8e8000] <lgl> 
├─HINS7 = [252:0x164468000] <lgl> 
├─MARHD = [253:0x164b08000] <lgl> 
├─MARHM = [254:0x1314a8000] <lgl> 
├─MARHT = [255:0x3893e8000] <fct> 
├─MARHW = [256:0x125e98000] <lgl> 
├─MARHYP = [257:0x35ea00000] <chr> 
├─DIS = [258:0x154178000] <lgl> 
├─HICOV = [259:0x1651a8000] <lgl> 
├─PRIVCOV = [260:0x165848000] <lgl> 
├─PUBCOV = [261:0x3227c8000] <lgl> 
├─FCITWP = [262:0x154818000] <lgl> 
├─FDEARP = [263:0x322e68000] <lgl> 
├─FDRATP = [264:0x323508000] <lgl> 
├─FDRATXP = [265:0x17d0c0000] <lgl> 
├─FHINS1P = [266:0x17d760000] <lgl> 
├─FHINS2P = [267:0x328008000] <lgl> 
├─FHINS3P = [268:0x154eb8000] <lgl> 
├─FHINS4P = [269:0x155558000] <lgl> 
├─FHINS5P = [270:0x30b508000] <lgl> 
├─FHINS6P = [271:0x31cf88000] <lgl> 
├─FHINS7P = [272:0x3113e8000] <lgl> 
├─FMARHDP = [273:0x3286a8000] <lgl> 
├─FMARHMP = [274:0x328d48000] <lgl> 
├─FMARHTP = [275:0x323ba8000] <lgl> 
├─FMARHWP = [276:0x324248000] <lgl> 
├─FMARHYP = [277:0x3248e8000] <lgl> 
├─WRK = [278:0x146c60000] <lgl> 
├─FOD1P = [279:0x3b0d40000] <chr> 
├─FOD2P = [280:0x3b27c0000] <chr> 
├─SCIENGP = [281:0x311a88000] <lgl> 
├─SCIENGRLP = [282:0x17de00000] <lgl> 
├─FFODP = [283:0x30bba8000] <lgl> 
├─FHINS3C = [284:0x38a128000] <fct> 
├─FHINS4C = [285:0x38ae68000] <fct> 
├─FHINS5C = [286:0x38bba8000] <fct> 
├─RELP = [287:0x3b4240000] <chr> 
├─FWRKP = [288:0x17e4a0000] <lgl> 
├─FDISP = [289:0x17eb40000] <lgl> 
├─FPERNP = [290:0x17f1e0000] <lgl> 
├─FPINCP = [291:0x31d628000] <lgl> 
├─FPRIVCOVP = [292:0x31dcc8000] <lgl> 
├─FPUBCOVP = [293:0x31e368000] <lgl> 
├─RACNH = [294:0x126538000] <lgl> 
├─RACPI = [295:0x3293e8000] <lgl> 
├─SSPA = [296:0x38c8e8000] <fct> 
├─MLPCD = [297:0x329a88000] <lgl> 
├─MLPFG = [298:0x32a128000] <lgl> 
├─FHICOVP = [299:0x32a7c8000] <lgl> 
├─DIVISION = [300:0x38d628000] <fct> 
├─REGION = [301:0x38e368000] <fct> 
├─HIMRKS = [302:0x38f0a8000] <fct> 
├─JWTRNS = [303:0x3b5cc0000] <chr> 
├─RELSHIPP = [304:0x3b7740000] <chr> 
├─WKWN = [305:0x132f28000] <int> 
├─FHIMRKSP = [306:0x131b48000] <lgl> 
├─FJWTRNSP = [307:0x155bf8000] <lgl> 
├─FRELSHIPP = [308:0x32ae68000] <lgl> 
├─FWKWNP = [309:0x32b508000] <lgl> 
├─MLPIK = [310:0x32bba8000] <lgl> 
├─year = [311:0x133c68000] <int> 
├─location = [312:0x3b91c0000] <chr> 
├─age_groups = [313:0x15c540000] <chr> 
├─ins_type = [314:0x15dfc0000] <chr> 
└─age_decade = [315:0x35dcc0000] <dbl>

3. Memory Efficient

Modify by reference - no copies

# Deep Copy (full dataset copied)
pums_copy <- copy(pums)

# adding variable to this does not alter the original
pums_copy[, age_decade := floor(AGEP / 10) * 10]
lobstr::ref(pums)
█ [1:0x10d207e00] <dt[,314]> 
├─SPORDER = [2:0x165f38000] <int> 
├─RT = [3:0x166c78000] <fct> 
├─SERIALNO = [4:0x10d800000] <chr> 
├─PUMA = [5:0x116800000] <chr> 
├─ST = [6:0x118280000] <chr> 
├─ADJUST = [7:0x147300000] <int> 
├─PWGTP = [8:0x3386a8000] <int> 
├─AGEP = [9:0x3393e8000] <int> 
├─CIT = [10:0x33a128000] <fct> 
├─COW = [11:0x33ae68000] <fct> 
├─DDRS = [12:0x140900000] <lgl> 
├─DEYE = [13:0x300018000] <lgl> 
├─DOUT = [14:0x3006b8000] <lgl> 
├─DPHY = [15:0x308008000] <lgl> 
├─DREM = [16:0x178140000] <lgl> 
├─DWRK = [17:0x1787e0000] <lgl> 
├─ENG = [18:0x33bba8000] <fct> 
├─FER = [19:0x120878000] <lgl> 
├─GCL = [20:0x161608000] <lgl> 
├─GCM = [21:0x33c8e8000] <fct> 
├─GCR = [22:0x140fa0000] <lgl> 
├─INTP = [23:0x33d628000] <int> 
├─JWMNP = [24:0x33e368000] <int> 
├─JWRIP = [25:0x11e200000] <chr> 
├─JWTR = [26:0x128000000] <chr> 
├─LANX = [27:0x141640000] <lgl> 
├─MAR = [28:0x33f0a8000] <fct> 
├─MIG = [29:0x141ce0000] <lgl> 
├─MIL = [30:0x340008000] <fct> 
├─MILY = [31:0x340d48000] <fct> 
├─MLPA = [32:0x310008000] <lgl> 
├─MLPB = [33:0x142380000] <lgl> 
├─MLPC = [34:0x142a20000] <lgl> 
├─MLPD = [35:0x318008000] <lgl> 
├─MLPE = [36:0x161ca8000] <lgl> 
├─MLPF = [37:0x162348000] <lgl> 
├─MLPG = [38:0x1629e8000] <lgl> 
├─MLPH = [39:0x1300c8000] <lgl> 
├─MLPI = [40:0x1430c0000] <lgl> 
├─MLPJ = [41:0x3186a8000] <lgl> 
├─MLPK = [42:0x318d48000] <lgl> 
├─NWAB = [43:0x3193e8000] <lgl> 
├─NWAV = [44:0x341a88000] <fct> 
├─NWLA = [45:0x319a88000] <lgl> 
├─NWLK = [46:0x31a128000] <lgl> 
├─NWRE = [47:0x120f18000] <lgl> 
├─OIP = [48:0x3427c8000] <int> 
├─PAP = [49:0x343508000] <int> 
├─REL = [50:0x12c000000] <chr> 
├─RETP = [51:0x303bb8000] <int> 
├─SCH = [52:0x1215b8000] <lgl> 
├─SCHG = [53:0x12da80000] <chr> 
├─SCHL = [54:0x138000000] <chr> 
├─SEMP = [55:0x330410000] <int> 
├─SEX = [56:0x331150000] <fct> 
├─SSIP = [57:0x331e90000] <int> 
├─SSP = [58:0x332bd0000] <int> 
├─WAGP = [59:0x333910000] <int> 
├─WKHP = [60:0x334650000] <int> 
├─WKL = [61:0x335390000] <fct> 
├─WKW = [62:0x3360d0000] <fct> 
├─YOEP = [63:0x13b800000] <chr> 
├─UWRK = [64:0x121c58000] <lgl> 
├─ANC = [65:0x336e10000] <fct> 
├─ANC1P = [66:0x13d280000] <chr> 
├─ANC2P = [67:0x13ed00000] <chr> 
├─DECADE = [68:0x344248000] <fct> 
├─DRIVESP = [69:0x344f88000] <fct> 
├─DS = [70:0x1222f8000] <lgl> 
├─ESP = [71:0x345cc8000] <fct> 
├─ESR = [72:0x346a08000] <fct> 
├─HISP = [73:0x148d40000] <chr> 
├─INDP = [74:0x14dd40000] <chr> 
├─JWAP = [75:0x158000000] <chr> 
├─JWDP = [76:0x15b800000] <chr> 
├─LANP = [77:0x15d280000] <chr> 
├─MIGPUMA = [78:0x156298000] <fct> 
├─MIGSP = [79:0x15ed00000] <chr> 
├─MSP = [80:0x126bd8000] <fct> 
├─NAICSP = [81:0x168d40000] <chr> 
├─NATIVITY = [82:0x127918000] <fct> 
├─OC = [83:0x178e80000] <lgl> 
├─OCCP = [84:0x16a7c0000] <chr> 
├─PAOC = [85:0x3486a8000] <fct> 
├─PERNP = [86:0x3493e8000] <int> 
├─PINCP = [87:0x34a128000] <int> 
├─POBP = [88:0x1711a0000] <chr> 
├─POVPIP = [89:0x34ae68000] <int> 
├─POWPUMA = [90:0x34bba8000] <fct> 
├─POWSP = [91:0x172c20000] <chr> 
├─QTRBIR = [92:0x34c8e8000] <fct> 
├─RAC1P = [93:0x34d628000] <fct> 
├─RAC2P = [94:0x1746a0000] <chr> 
├─RAC3P = [95:0x176120000] <chr> 
├─RACAIAN = [96:0x122998000] <lgl> 
├─RACASN = [97:0x320008000] <lgl> 
├─RACBLK = [98:0x130768000] <lgl> 
├─RACNHPI = [99:0x3206a8000] <lgl> 
├─RACNUM = [100:0x34e368000] <int> 
├─RACSOR = [101:0x163088000] <lgl> 
├─RACWHT = [102:0x3086a8000] <lgl> 
├─RC = [103:0x31a7c8000] <lgl> 
├─SFN = [104:0x34f0a8000] <fct> 
├─SFR = [105:0x350008000] <fct> 
├─SOCP = [106:0x358000000] <chr> 
├─VPS = [107:0x359a80000] <chr> 
├─WAOB = [108:0x350d48000] <fct> 
├─FAGEP = [109:0x150c78000] <lgl> 
├─FANCP = [110:0x143760000] <lgl> 
├─FCITP = [111:0x320d48000] <lgl> 
├─FCOWP = [112:0x300d58000] <lgl> 
├─FDDRSP = [113:0x130e08000] <lgl> 
├─FDEYEP = [114:0x179520000] <lgl> 
├─FDOUTP = [115:0x179bc0000] <lgl> 
├─FDPHYP = [116:0x151318000] <lgl> 
├─FDREMP = [117:0x3106a8000] <lgl> 
├─FDWRKP = [118:0x17a260000] <lgl> 
├─FENGP = [119:0x17a900000] <lgl> 
├─FESRP = [120:0x17afa0000] <lgl> 
├─FFERP = [121:0x123038000] <lgl> 
├─FGCLP = [122:0x1236d8000] <lgl> 
├─FGCMP = [123:0x1519b8000] <lgl> 
├─FGCRP = [124:0x3213e8000] <lgl> 
├─FHISP = [125:0x123d78000] <lgl> 
├─FINDP = [126:0x124418000] <lgl> 
├─FINTP = [127:0x124ab8000] <lgl> 
├─FJWDP = [128:0x163728000] <lgl> 
├─FJWMNP = [129:0x321a88000] <lgl> 
├─FJWRIP = [130:0x310d48000] <lgl> 
├─FJWTRP = [131:0x31ae68000] <lgl> 
├─FLANP = [132:0x31b508000] <lgl> 
├─FLANXP = [133:0x308d48000] <lgl> 
├─FMARP = [134:0x3013f8000] <lgl> 
├─FMIGP = [135:0x301a98000] <lgl> 
├─FMIGSP = [136:0x322128000] <lgl> 
├─FMILPP = [137:0x17b640000] <lgl> 
├─FMILSP = [138:0x17bce0000] <lgl> 
├─FMILYP = [139:0x3093e8000] <lgl> 
├─FOCCP = [140:0x309a88000] <lgl> 
├─FOIP = [141:0x30a128000] <lgl> 
├─FPAP = [142:0x143e00000] <lgl> 
├─FPOBP = [143:0x1444a0000] <lgl> 
├─FPOWSP = [144:0x125158000] <lgl> 
├─FRACP = [145:0x1257f8000] <lgl> 
├─FRELP = [146:0x17c380000] <lgl> 
├─FRETP = [147:0x152058000] <lgl> 
├─FSCHGP = [148:0x1526f8000] <lgl> 
├─FSCHLP = [149:0x152d98000] <lgl> 
├─FSCHP = [150:0x163dc8000] <lgl> 
├─FSEMP = [151:0x144b40000] <lgl> 
├─FSEXP = [152:0x1451e0000] <lgl> 
├─FSSIP = [153:0x302138000] <lgl> 
├─FSSP = [154:0x3027d8000] <lgl> 
├─FWAGP = [155:0x302e78000] <lgl> 
├─FWKHP = [156:0x303518000] <lgl> 
├─FWKLP = [157:0x30a7c8000] <lgl> 
├─FWKWP = [158:0x30ae68000] <lgl> 
├─FYOEP = [159:0x17ca20000] <lgl> 
├─PWGTP1 = [160:0x351a88000] <int> 
├─PWGTP2 = [161:0x3527c8000] <int> 
├─PWGTP3 = [162:0x353508000] <int> 
├─PWGTP4 = [163:0x354248000] <int> 
├─PWGTP5 = [164:0x354f88000] <int> 
├─PWGTP6 = [165:0x1321e8000] <int> 
├─PWGTP7 = [166:0x360008000] <int> 
├─PWGTP8 = [167:0x360d48000] <int> 
├─PWGTP9 = [168:0x361a88000] <int> 
├─PWGTP10 = [169:0x3627c8000] <int> 
├─PWGTP11 = [170:0x363508000] <int> 
├─PWGTP12 = [171:0x364248000] <int> 
├─PWGTP13 = [172:0x347748000] <int> 
├─PWGTP14 = [173:0x3686a8000] <int> 
├─PWGTP15 = [174:0x3693e8000] <int> 
├─PWGTP16 = [175:0x355cc8000] <int> 
├─PWGTP17 = [176:0x36a128000] <int> 
├─PWGTP18 = [177:0x36ae68000] <int> 
├─PWGTP19 = [178:0x36bba8000] <int> 
├─PWGTP20 = [179:0x36c8e8000] <int> 
├─PWGTP21 = [180:0x156fd8000] <int> 
├─PWGTP22 = [181:0x370008000] <int> 
├─PWGTP23 = [182:0x370d48000] <int> 
├─PWGTP24 = [183:0x371a88000] <int> 
├─PWGTP25 = [184:0x3727c8000] <int> 
├─PWGTP26 = [185:0x364f88000] <int> 
├─PWGTP27 = [186:0x365cc8000] <int> 
├─PWGTP28 = [187:0x366a08000] <int> 
├─PWGTP29 = [188:0x367748000] <int> 
├─PWGTP30 = [189:0x3786a8000] <int> 
├─PWGTP31 = [190:0x3793e8000] <int> 
├─PWGTP32 = [191:0x37a128000] <int> 
├─PWGTP33 = [192:0x37ae68000] <int> 
├─PWGTP34 = [193:0x37bba8000] <int> 
├─PWGTP35 = [194:0x37c8e8000] <int> 
├─PWGTP36 = [195:0x37d628000] <int> 
├─PWGTP37 = [196:0x37e368000] <int> 
├─PWGTP38 = [197:0x37f0a8000] <int> 
├─PWGTP39 = [198:0x380008000] <int> 
├─PWGTP40 = [199:0x36d628000] <int> 
├─PWGTP41 = [200:0x36e368000] <int> 
├─PWGTP42 = [201:0x373508000] <int> 
├─PWGTP43 = [202:0x374248000] <int> 
├─PWGTP44 = [203:0x380d48000] <int> 
├─PWGTP45 = [204:0x381a88000] <int> 
├─PWGTP46 = [205:0x3827c8000] <int> 
├─PWGTP47 = [206:0x383508000] <int> 
├─PWGTP48 = [207:0x384248000] <int> 
├─PWGTP49 = [208:0x384f88000] <int> 
├─PWGTP50 = [209:0x385cc8000] <int> 
├─PWGTP51 = [210:0x386a08000] <int> 
├─PWGTP52 = [211:0x387748000] <int> 
├─PWGTP53 = [212:0x356a08000] <int> 
├─PWGTP54 = [213:0x357748000] <int> 
├─PWGTP55 = [214:0x3906a8000] <int> 
├─PWGTP56 = [215:0x3913e8000] <int> 
├─PWGTP57 = [216:0x392128000] <int> 
├─PWGTP58 = [217:0x392e68000] <int> 
├─PWGTP59 = [218:0x393ba8000] <int> 
├─PWGTP60 = [219:0x3948e8000] <int> 
├─PWGTP61 = [220:0x395628000] <int> 
├─PWGTP62 = [221:0x396368000] <int> 
├─PWGTP63 = [222:0x3970a8000] <int> 
├─PWGTP64 = [223:0x398008000] <int> 
├─PWGTP65 = [224:0x398d48000] <int> 
├─PWGTP66 = [225:0x399a88000] <int> 
├─PWGTP67 = [226:0x39a7c8000] <int> 
├─PWGTP68 = [227:0x39b508000] <int> 
├─PWGTP69 = [228:0x39c248000] <int> 
├─PWGTP70 = [229:0x39cf88000] <int> 
├─PWGTP71 = [230:0x39dcc8000] <int> 
├─PWGTP72 = [231:0x39ea08000] <int> 
├─PWGTP73 = [232:0x39f748000] <int> 
├─PWGTP74 = [233:0x3a06a8000] <int> 
├─PWGTP75 = [234:0x374f88000] <int> 
├─PWGTP76 = [235:0x36f0a8000] <int> 
├─PWGTP77 = [236:0x3a8008000] <int> 
├─PWGTP78 = [237:0x3a8d48000] <int> 
├─PWGTP79 = [238:0x3a9a88000] <int> 
├─PWGTP80 = [239:0x3aa7c8000] <int> 
├─NOP = [240:0x3ab508000] <fct> 
├─ADJINC = [241:0x35b500000] <dbl> 
├─CITWP = [242:0x35cf80000] <chr> 
├─DEAR = [243:0x31bba8000] <lgl> 
├─DRAT = [244:0x3886a8000] <fct> 
├─DRATX = [245:0x153438000] <lgl> 
├─HINS1 = [246:0x153ad8000] <lgl> 
├─HINS2 = [247:0x145880000] <lgl> 
├─HINS3 = [248:0x145f20000] <lgl> 
├─HINS4 = [249:0x1465c0000] <lgl> 
├─HINS5 = [250:0x31c248000] <lgl> 
├─HINS6 = [251:0x31c8e8000] <lgl> 
├─HINS7 = [252:0x164468000] <lgl> 
├─MARHD = [253:0x164b08000] <lgl> 
├─MARHM = [254:0x1314a8000] <lgl> 
├─MARHT = [255:0x3893e8000] <fct> 
├─MARHW = [256:0x125e98000] <lgl> 
├─MARHYP = [257:0x35ea00000] <chr> 
├─DIS = [258:0x154178000] <lgl> 
├─HICOV = [259:0x1651a8000] <lgl> 
├─PRIVCOV = [260:0x165848000] <lgl> 
├─PUBCOV = [261:0x3227c8000] <lgl> 
├─FCITWP = [262:0x154818000] <lgl> 
├─FDEARP = [263:0x322e68000] <lgl> 
├─FDRATP = [264:0x323508000] <lgl> 
├─FDRATXP = [265:0x17d0c0000] <lgl> 
├─FHINS1P = [266:0x17d760000] <lgl> 
├─FHINS2P = [267:0x328008000] <lgl> 
├─FHINS3P = [268:0x154eb8000] <lgl> 
├─FHINS4P = [269:0x155558000] <lgl> 
├─FHINS5P = [270:0x30b508000] <lgl> 
├─FHINS6P = [271:0x31cf88000] <lgl> 
├─FHINS7P = [272:0x3113e8000] <lgl> 
├─FMARHDP = [273:0x3286a8000] <lgl> 
├─FMARHMP = [274:0x328d48000] <lgl> 
├─FMARHTP = [275:0x323ba8000] <lgl> 
├─FMARHWP = [276:0x324248000] <lgl> 
├─FMARHYP = [277:0x3248e8000] <lgl> 
├─WRK = [278:0x146c60000] <lgl> 
├─FOD1P = [279:0x3b0d40000] <chr> 
├─FOD2P = [280:0x3b27c0000] <chr> 
├─SCIENGP = [281:0x311a88000] <lgl> 
├─SCIENGRLP = [282:0x17de00000] <lgl> 
├─FFODP = [283:0x30bba8000] <lgl> 
├─FHINS3C = [284:0x38a128000] <fct> 
├─FHINS4C = [285:0x38ae68000] <fct> 
├─FHINS5C = [286:0x38bba8000] <fct> 
├─RELP = [287:0x3b4240000] <chr> 
├─FWRKP = [288:0x17e4a0000] <lgl> 
├─FDISP = [289:0x17eb40000] <lgl> 
├─FPERNP = [290:0x17f1e0000] <lgl> 
├─FPINCP = [291:0x31d628000] <lgl> 
├─FPRIVCOVP = [292:0x31dcc8000] <lgl> 
├─FPUBCOVP = [293:0x31e368000] <lgl> 
├─RACNH = [294:0x126538000] <lgl> 
├─RACPI = [295:0x3293e8000] <lgl> 
├─SSPA = [296:0x38c8e8000] <fct> 
├─MLPCD = [297:0x329a88000] <lgl> 
├─MLPFG = [298:0x32a128000] <lgl> 
├─FHICOVP = [299:0x32a7c8000] <lgl> 
├─DIVISION = [300:0x38d628000] <fct> 
├─REGION = [301:0x38e368000] <fct> 
├─HIMRKS = [302:0x38f0a8000] <fct> 
├─JWTRNS = [303:0x3b5cc0000] <chr> 
├─RELSHIPP = [304:0x3b7740000] <chr> 
├─WKWN = [305:0x132f28000] <int> 
├─FHIMRKSP = [306:0x131b48000] <lgl> 
├─FJWTRNSP = [307:0x155bf8000] <lgl> 
├─FRELSHIPP = [308:0x32ae68000] <lgl> 
├─FWKWNP = [309:0x32b508000] <lgl> 
├─MLPIK = [310:0x32bba8000] <lgl> 
├─year = [311:0x133c68000] <int> 
├─location = [312:0x3b91c0000] <chr> 
├─age_groups = [313:0x15c540000] <chr> 
├─ins_type = [314:0x15dfc0000] <chr> 
└─age_decade = [315:0x35dcc0000] <dbl> 
lobstr::ref(pums_copy)
█ [1:0x3bdfc2e00] <dt[,314]> 
├─SPORDER = [2:0x43a688000] <int> 
├─RT = [3:0x4359a8000] <fct> 
├─SERIALNO = [4:0x3b1a80000] <chr> 
├─PUMA = [5:0x3b0000000] <chr> 
├─ST = [6:0x168000000] <chr> 
├─ADJUST = [7:0x430488000] <int> 
├─PWGTP = [8:0x433028000] <int> 
├─AGEP = [9:0x43aea8000] <int> 
├─CIT = [10:0x438008000] <fct> 
├─COW = [11:0x43ca08000] <fct> 
├─DDRS = [12:0x43c068000] <lgl> 
├─DEYE = [13:0x41f4c8000] <lgl> 
├─DOUT = [14:0x418488000] <lgl> 
├─DPHY = [15:0x4013e8000] <lgl> 
├─DREM = [16:0x401a88000] <lgl> 
├─DWRK = [17:0x402128000] <lgl> 
├─ENG = [18:0x4027c8000] <fct> 
├─FER = [19:0x402e68000] <lgl> 
├─GCL = [20:0x403508000] <lgl> 
├─GCM = [21:0x403ba8000] <fct> 
├─GCR = [22:0x404248000] <lgl> 
├─INTP = [23:0x4048e8000] <int> 
├─JWMNP = [24:0x404f88000] <int> 
├─JWRIP = [25:0x169a80000] <chr> 
├─JWTR = [26:0x170460000] <chr> 
├─LANX = [27:0x411738000] <lgl> 
├─MAR = [28:0x411dd8000] <fct> 
├─MIG = [29:0x412478000] <lgl> 
├─MIL = [30:0x412b18000] <fct> 
├─MILY = [31:0x4131b8000] <fct> 
├─MLPA = [32:0x413858000] <lgl> 
├─MLPB = [33:0x413ef8000] <lgl> 
├─MLPC = [34:0x414a30000] <lgl> 
├─MLPD = [35:0x4150d0000] <lgl> 
├─MLPE = [36:0x415770000] <lgl> 
├─MLPF = [37:0x415e10000] <lgl> 
├─MLPG = [38:0x4164b0000] <lgl> 
├─MLPH = [39:0x416b50000] <lgl> 
├─MLPI = [40:0x4171f0000] <lgl> 
├─MLPJ = [41:0x417890000] <lgl> 
├─MLPK = [42:0x42f388000] <lgl> 
├─NWAB = [43:0x429ce8000] <lgl> 
├─NWAV = [44:0x4289a8000] <fct> 
├─NWLA = [45:0x428008000] <lgl> 
├─NWLK = [46:0x42d528000] <lgl> 
├─NWRE = [47:0x42cb88000] <lgl> 
├─OIP = [48:0x42b848000] <int> 
├─PAP = [49:0x4291c8000] <int> 
├─REL = [50:0x171ee0000] <chr> 
├─RETP = [51:0x4478a8000] <int> 
├─SCH = [52:0x446f08000] <lgl> 
├─SCHG = [53:0x173960000] <chr> 
├─SCHL = [54:0x1753e0000] <chr> 
├─SEMP = [55:0x446568000] <int> 
├─SEX = [56:0x445bc8000] <fct> 
├─SSIP = [57:0x445228000] <int> 
├─SSP = [58:0x444888000] <int> 
├─WAGP = [59:0x443ee8000] <int> 
├─WKHP = [60:0x443548000] <int> 
├─WKL = [61:0x4211c8000] <fct> 
├─WKW = [62:0x424b88000] <fct> 
├─YOEP = [63:0x176e60000] <chr> 
├─UWRK = [64:0x422ea8000] <lgl> 
├─ANC = [65:0x40bc88000] <fct> 
├─ANC1P = [66:0x358d40000] <chr> 
├─ANC2P = [67:0x35a7c0000] <chr> 
├─DECADE = [68:0x40c328000] <fct> 
├─DRIVESP = [69:0x40d7e8000] <fct> 
├─DS = [70:0x40de88000] <lgl> 
├─ESP = [71:0x40e528000] <fct> 
├─ESR = [72:0x40ebc8000] <fct> 
├─HISP = [73:0x35c240000] <chr> 
├─INDP = [74:0x3b3500000] <chr> 
├─JWAP = [75:0x3b4f80000] <chr> 
├─JWDP = [76:0x480000000] <chr> 
├─LANP = [77:0x481a7c000] <chr> 
├─MIGPUMA = [78:0x40f268000] <fct> 
├─MIGSP = [79:0x4834f8000] <chr> 
├─MSP = [80:0x40b2e8000] <fct> 
├─NAICSP = [81:0x484f74000] <chr> 
├─NATIVITY = [82:0x40a948000] <fct> 
├─OC = [83:0x40ce48000] <lgl> 
├─OCCP = [84:0x4869f0000] <chr> 
├─PAOC = [85:0x4236c8000] <fct> 
├─PERNP = [86:0x424068000] <int> 
├─PINCP = [87:0x426048000] <int> 
├─POBP = [88:0x48846c000] <chr> 
├─POVPIP = [89:0x4219e8000] <int> 
├─POWPUMA = [90:0x44f688000] <fct> 
├─POWSP = [91:0x489ee8000] <chr> 
├─QTRBIR = [92:0x44ece8000] <fct> 
├─RAC1P = [93:0x44e348000] <fct> 
├─RAC2P = [94:0x48b964000] <chr> 
├─RAC3P = [95:0x48d3e0000] <chr> 
├─RACAIAN = [96:0x44d9a8000] <lgl> 
├─RACASN = [97:0x44d008000] <lgl> 
├─RACBLK = [98:0x44c668000] <lgl> 
├─RACNHPI = [99:0x44bcc8000] <lgl> 
├─RACNUM = [100:0x44b328000] <int> 
├─RACSOR = [101:0x44a988000] <lgl> 
├─RACWHT = [102:0x449fe8000] <lgl> 
├─RC = [103:0x449648000] <lgl> 
├─SFN = [104:0x448ca8000] <fct> 
├─SFR = [105:0x448308000] <fct> 
├─SOCP = [106:0x48ee5c000] <chr> 
├─VPS = [107:0x3eea68000] <chr> 
├─WAOB = [108:0x457508000] <fct> 
├─FAGEP = [109:0x456b68000] <lgl> 
├─FANCP = [110:0x4561c8000] <lgl> 
├─FCITP = [111:0x442ba8000] <lgl> 
├─FCOWP = [112:0x442208000] <lgl> 
├─FDDRSP = [113:0x441868000] <lgl> 
├─FDEYEP = [114:0x440ec8000] <lgl> 
├─FDOUTP = [115:0x440008000] <lgl> 
├─FDPHYP = [116:0x4406a8000] <lgl> 
├─FDREMP = [117:0x498008000] <lgl> 
├─FDWRKP = [118:0x4986a8000] <lgl> 
├─FENGP = [119:0x498d48000] <lgl> 
├─FESRP = [120:0x4993e8000] <lgl> 
├─FFERP = [121:0x397748000] <lgl> 
├─FGCLP = [122:0x476048000] <lgl> 
├─FGCMP = [123:0x474d08000] <lgl> 
├─FGCRP = [124:0x471ce8000] <lgl> 
├─FHISP = [125:0x474368000] <lgl> 
├─FINDP = [126:0x47bcc8000] <lgl> 
├─FINTP = [127:0x472688000] <lgl> 
├─FJWDP = [128:0x4739c8000] <lgl> 
├─FJWMNP = [129:0x473028000] <lgl> 
├─FJWRIP = [130:0x4756a8000] <lgl> 
├─FJWTRP = [131:0x4709a8000] <lgl> 
├─FLANP = [132:0x471348000] <lgl> 
├─FLANXP = [133:0x470008000] <lgl> 
├─FMARP = [134:0x478188000] <lgl> 
├─FMIGP = [135:0x476b68000] <lgl> 
├─FMIGSP = [136:0x479e68000] <lgl> 
├─FMILPP = [137:0x4794c8000] <lgl> 
├─FMILSP = [138:0x478b28000] <lgl> 
├─FMILYP = [139:0x47a808000] <lgl> 
├─FOCCP = [140:0x47c668000] <lgl> 
├─FOIP = [141:0x47b1a8000] <lgl> 
├─FPAP = [142:0x46f508000] <lgl> 
├─FPOBP = [143:0x46eb68000] <lgl> 
├─FPOWSP = [144:0x46e1c8000] <lgl> 
├─FRACP = [145:0x46d828000] <lgl> 
├─FRELP = [146:0x46ce88000] <lgl> 
├─FRETP = [147:0x46c4e8000] <lgl> 
├─FSCHGP = [148:0x46bb48000] <lgl> 
├─FSCHLP = [149:0x46b1a8000] <lgl> 
├─FSCHP = [150:0x3f86a8000] <lgl> 
├─FSEMP = [151:0x3f8d48000] <lgl> 
├─FSEXP = [152:0x3f93e8000] <lgl> 
├─FSSIP = [153:0x3f9a88000] <lgl> 
├─FSSP = [154:0x3fa128000] <lgl> 
├─FWAGP = [155:0x3fa7c8000] <lgl> 
├─FWKHP = [156:0x3fae68000] <lgl> 
├─FWKLP = [157:0x3fb508000] <lgl> 
├─FWKWP = [158:0x3fbba8000] <lgl> 
├─FYOEP = [159:0x3fc248000] <lgl> 
├─PWGTP1 = [160:0x3fc8e8000] <int> 
├─PWGTP2 = [161:0x3fcf88000] <int> 
├─PWGTP3 = [162:0x3fd628000] <int> 
├─PWGTP4 = [163:0x3fe350000] <int> 
├─PWGTP5 = [164:0x3fe9f0000] <int> 
├─PWGTP6 = [165:0x3ff090000] <int> 
├─PWGTP7 = [166:0x3ff730000] <int> 
├─PWGTP8 = [167:0x4a0008000] <int> 
├─PWGTP9 = [168:0x4a06a8000] <int> 
├─PWGTP10 = [169:0x4a0d48000] <int> 
├─PWGTP11 = [170:0x4a13e8000] <int> 
├─PWGTP12 = [171:0x405628000] <int> 
├─PWGTP13 = [172:0x46a808000] <int> 
├─PWGTP14 = [173:0x469e68000] <int> 
├─PWGTP15 = [174:0x4694c8000] <int> 
├─PWGTP16 = [175:0x455828000] <int> 
├─PWGTP17 = [176:0x454e88000] <int> 
├─PWGTP18 = [177:0x499a88000] <int> 
├─PWGTP19 = [178:0x49a128000] <int> 
├─PWGTP20 = [179:0x49a7c8000] <int> 
├─PWGTP21 = [180:0x405cc8000] <int> 
├─PWGTP22 = [181:0x406368000] <int> 
├─PWGTP23 = [182:0x406a08000] <int> 
├─PWGTP24 = [183:0x4070a8000] <int> 
├─PWGTP25 = [184:0x4544e8000] <int> 
├─PWGTP26 = [185:0x453b48000] <int> 
├─PWGTP27 = [186:0x4531a8000] <int> 
├─PWGTP28 = [187:0x452808000] <int> 
├─PWGTP29 = [188:0x49ae68000] <int> 
├─PWGTP30 = [189:0x49b508000] <int> 
├─PWGTP31 = [190:0x451e68000] <int> 
├─PWGTP32 = [191:0x4514c8000] <int> 
├─PWGTP33 = [192:0x450b28000] <int> 
├─PWGTP34 = [193:0x450188000] <int> 
├─PWGTP35 = [194:0x4689a8000] <int> 
├─PWGTP36 = [195:0x468008000] <int> 
├─PWGTP37 = [196:0x467508000] <int> 
├─PWGTP38 = [197:0x466b68000] <int> 
├─PWGTP39 = [198:0x4661c8000] <int> 
├─PWGTP40 = [199:0x4a8008000] <int> 
├─PWGTP41 = [200:0x49bba8000] <int> 
├─PWGTP42 = [201:0x4a1a88000] <int> 
├─PWGTP43 = [202:0x4a2128000] <int> 
├─PWGTP44 = [203:0x4a27c8000] <int> 
├─PWGTP45 = [204:0x4a2e68000] <int> 
├─PWGTP46 = [205:0x40f908000] <int> 
├─PWGTP47 = [206:0x4a86a8000] <int> 
├─PWGTP48 = [207:0x407748000] <int> 
├─PWGTP49 = [208:0x41c328000] <int> 
├─PWGTP50 = [209:0x49c248000] <int> 
├─PWGTP51 = [210:0x49c8e8000] <int> 
├─PWGTP52 = [211:0x4a8d48000] <int> 
├─PWGTP53 = [212:0x49cf88000] <int> 
├─PWGTP54 = [213:0x49d628000] <int> 
├─PWGTP55 = [214:0x49dcc8000] <int> 
├─PWGTP56 = [215:0x41a728000] <int> 
├─PWGTP57 = [216:0x49e368000] <int> 
├─PWGTP58 = [217:0x49ea08000] <int> 
├─PWGTP59 = [218:0x49f0a8000] <int> 
├─PWGTP60 = [219:0x49f748000] <int> 
├─PWGTP61 = [220:0x4b0008000] <int> 
├─PWGTP62 = [221:0x4a93e8000] <int> 
├─PWGTP63 = [222:0x465828000] <int> 
├─PWGTP64 = [223:0x464e88000] <int> 
├─PWGTP65 = [224:0x4644e8000] <int> 
├─PWGTP66 = [225:0x463b48000] <int> 
├─PWGTP67 = [226:0x4a9a88000] <int> 
├─PWGTP68 = [227:0x4631a8000] <int> 
├─PWGTP69 = [228:0x462808000] <int> 
├─PWGTP70 = [229:0x4aa128000] <int> 
├─PWGTP71 = [230:0x4aa7c8000] <int> 
├─PWGTP72 = [231:0x4a3508000] <int> 
├─PWGTP73 = [232:0x4b06a8000] <int> 
├─PWGTP74 = [233:0x4aae68000] <int> 
├─PWGTP75 = [234:0x4ab508000] <int> 
├─PWGTP76 = [235:0x461e68000] <int> 
├─PWGTP77 = [236:0x4614c8000] <int> 
├─PWGTP78 = [237:0x4b0d48000] <int> 
├─PWGTP79 = [238:0x4b13e8000] <int> 
├─PWGTP80 = [239:0x4b1a88000] <int> 
├─NOP = [240:0x460b28000] <fct> 
├─ADJINC = [241:0x4908d8000] <dbl> 
├─CITWP = [242:0x491618000] <chr> 
├─DEAR = [243:0x4abba8000] <lgl> 
├─DRAT = [244:0x4b2128000] <fct> 
├─DRATX = [245:0x45f508000] <lgl> 
├─HINS1 = [246:0x45e9e8000] <lgl> 
├─HINS2 = [247:0x45e048000] <lgl> 
├─HINS3 = [248:0x4b27c8000] <lgl> 
├─HINS4 = [249:0x45d6a8000] <lgl> 
├─HINS5 = [250:0x4ac248000] <lgl> 
├─HINS6 = [251:0x4ac8e8000] <lgl> 
├─HINS7 = [252:0x45cd08000] <lgl> 
├─MARHD = [253:0x45c368000] <lgl> 
├─MARHM = [254:0x45b9c8000] <lgl> 
├─MARHT = [255:0x45b028000] <fct> 
├─MARHW = [256:0x45a688000] <lgl> 
├─MARHYP = [257:0x492358000] <chr> 
├─DIS = [258:0x4acf88000] <lgl> 
├─HICOV = [259:0x4ad628000] <lgl> 
├─PRIVCOV = [260:0x4adcc8000] <lgl> 
├─PUBCOV = [261:0x4b2e68000] <lgl> 
├─FCITWP = [262:0x4b3508000] <lgl> 
├─FDEARP = [263:0x4b3ba8000] <lgl> 
├─FDRATP = [264:0x4b4248000] <lgl> 
├─FDRATXP = [265:0x4b48e8000] <lgl> 
├─FHINS1P = [266:0x4b4f88000] <lgl> 
├─FHINS2P = [267:0x459ce8000] <lgl> 
├─FHINS3P = [268:0x459348000] <lgl> 
├─FHINS4P = [269:0x4ae368000] <lgl> 
├─FHINS5P = [270:0x4aea08000] <lgl> 
├─FHINS6P = [271:0x4af0a8000] <lgl> 
├─FHINS7P = [272:0x4af748000] <lgl> 
├─FMARHDP = [273:0x4b8008000] <lgl> 
├─FMARHMP = [274:0x4b86a8000] <lgl> 
├─FMARHTP = [275:0x4b8d48000] <lgl> 
├─FMARHWP = [276:0x4a3ba8000] <lgl> 
├─FMARHYP = [277:0x4589a8000] <lgl> 
├─WRK = [278:0x458008000] <lgl> 
├─FOD1P = [279:0x493098000] <chr> 
├─FOD2P = [280:0x493dd8000] <chr> 
├─SCIENGP = [281:0x4b93e8000] <lgl> 
├─SCIENGRLP = [282:0x4b9a88000] <lgl> 
├─FFODP = [283:0x47ce88000] <lgl> 
├─FHINS3C = [284:0x47d528000] <fct> 
├─FHINS4C = [285:0x47dbc8000] <fct> 
├─FHINS5C = [286:0x4b5628000] <fct> 
├─RELP = [287:0x494b18000] <chr> 
├─FWRKP = [288:0x4ba128000] <lgl> 
├─FDISP = [289:0x4ba7c8000] <lgl> 
├─FPERNP = [290:0x4bae68000] <lgl> 
├─FPINCP = [291:0x4bb508000] <lgl> 
├─FPRIVCOVP = [292:0x4bbba8000] <lgl> 
├─FPUBCOVP = [293:0x47e268000] <lgl> 
├─RACNH = [294:0x47e908000] <lgl> 
├─RACPI = [295:0x4b5cc8000] <lgl> 
├─SSPA = [296:0x47efa8000] <fct> 
├─MLPCD = [297:0x47f648000] <lgl> 
├─MLPFG = [298:0x4bc248000] <lgl> 
├─FHICOVP = [299:0x4b6368000] <lgl> 
├─DIVISION = [300:0x4bc8e8000] <fct> 
├─REGION = [301:0x4bcf88000] <fct> 
├─HIMRKS = [302:0x4b6a08000] <fct> 
├─JWTRNS = [303:0x495858000] <chr> 
├─RELSHIPP = [304:0x496598000] <chr> 
├─WKWN = [305:0x4a4248000] <int> 
├─FHIMRKSP = [306:0x4a48e8000] <lgl> 
├─FJWTRNSP = [307:0x4a4f88000] <lgl> 
├─FRELSHIPP = [308:0x4a5628000] <lgl> 
├─FWKWNP = [309:0x4c0008000] <lgl> 
├─MLPIK = [310:0x4c06a8000] <lgl> 
├─year = [311:0x4bd628000] <int> 
├─location = [312:0x4c8000000] <chr> 
├─age_groups = [313:0x4c8d40000] <chr> 
├─ins_type = [314:0x4c9a80000] <chr> 
└─age_decade = [315:0x4cb500000] <dbl>

set*() Functions

Memory-efficient operations by reference

The set*() family of functions modify data.table objects directly in memory without creating copies, making them essential for large datasets.

Why set functions are useful:

  1. Memory efficiency: No copies made, lower RAM usage
  2. Speed: Faster than traditional assignment operations
  3. Large data friendly: Essential when working with datasets that approach memory limits
  4. Consistent syntax: Uniform approach across different operations

Key set functions:

# setnames() - rename columns by reference
setnames(pums, "AGEP", "age") 
setnames(pums, c("old1", "old2"), c("new1", "new2"))

# setkey() - set keys for fast operations
setkey(pums, ST, year)  # Fast lookups and joins

# setorder() - sort by reference
setorder(pums, ST, -AGEP)  # Sort by state, then age descending

# set() - general purpose setter
set(pums, i = 1L, j = "AGEP", value = 99L)  # Set specific cell
set(pums, j = "new_col", value = 0L)        # Add column with default value

Tradeoffs of Modify by Reference

  1. Need to keep track of what is referencing the same data
  2. Use copies if you want to keep data independent
  3. When done properly, it can be very memory efficient

What will this do?

pums2 = pums
setnames(pums2, old = "SPORDER", new = "id")

What will this do?

pums2 = pums
setnames(pums2, old = "SPORDER", new = "id")
names(pums)
  [1] "id"         "RT"         "SERIALNO"   "PUMA"       "ST"        
  [6] "ADJUST"     "PWGTP"      "AGEP"       "CIT"        "COW"       
 [11] "DDRS"       "DEYE"       "DOUT"       "DPHY"       "DREM"      
 [16] "DWRK"       "ENG"        "FER"        "GCL"        "GCM"       
 [21] "GCR"        "INTP"       "JWMNP"      "JWRIP"      "JWTR"      
 [26] "LANX"       "MAR"        "MIG"        "MIL"        "MILY"      
 [31] "MLPA"       "MLPB"       "MLPC"       "MLPD"       "MLPE"      
 [36] "MLPF"       "MLPG"       "MLPH"       "MLPI"       "MLPJ"      
 [41] "MLPK"       "NWAB"       "NWAV"       "NWLA"       "NWLK"      
 [46] "NWRE"       "OIP"        "PAP"        "REL"        "RETP"      
 [51] "SCH"        "SCHG"       "SCHL"       "SEMP"       "SEX"       
 [56] "SSIP"       "SSP"        "WAGP"       "WKHP"       "WKL"       
 [61] "WKW"        "YOEP"       "UWRK"       "ANC"        "ANC1P"     
 [66] "ANC2P"      "DECADE"     "DRIVESP"    "DS"         "ESP"       
 [71] "ESR"        "HISP"       "INDP"       "JWAP"       "JWDP"      
 [76] "LANP"       "MIGPUMA"    "MIGSP"      "MSP"        "NAICSP"    
 [81] "NATIVITY"   "OC"         "OCCP"       "PAOC"       "PERNP"     
 [86] "PINCP"      "POBP"       "POVPIP"     "POWPUMA"    "POWSP"     
 [91] "QTRBIR"     "RAC1P"      "RAC2P"      "RAC3P"      "RACAIAN"   
 [96] "RACASN"     "RACBLK"     "RACNHPI"    "RACNUM"     "RACSOR"    
[101] "RACWHT"     "RC"         "SFN"        "SFR"        "SOCP"      
[106] "VPS"        "WAOB"       "FAGEP"      "FANCP"      "FCITP"     
[111] "FCOWP"      "FDDRSP"     "FDEYEP"     "FDOUTP"     "FDPHYP"    
[116] "FDREMP"     "FDWRKP"     "FENGP"      "FESRP"      "FFERP"     
[121] "FGCLP"      "FGCMP"      "FGCRP"      "FHISP"      "FINDP"     
[126] "FINTP"      "FJWDP"      "FJWMNP"     "FJWRIP"     "FJWTRP"    
[131] "FLANP"      "FLANXP"     "FMARP"      "FMIGP"      "FMIGSP"    
[136] "FMILPP"     "FMILSP"     "FMILYP"     "FOCCP"      "FOIP"      
[141] "FPAP"       "FPOBP"      "FPOWSP"     "FRACP"      "FRELP"     
[146] "FRETP"      "FSCHGP"     "FSCHLP"     "FSCHP"      "FSEMP"     
[151] "FSEXP"      "FSSIP"      "FSSP"       "FWAGP"      "FWKHP"     
[156] "FWKLP"      "FWKWP"      "FYOEP"      "PWGTP1"     "PWGTP2"    
[161] "PWGTP3"     "PWGTP4"     "PWGTP5"     "PWGTP6"     "PWGTP7"    
[166] "PWGTP8"     "PWGTP9"     "PWGTP10"    "PWGTP11"    "PWGTP12"   
[171] "PWGTP13"    "PWGTP14"    "PWGTP15"    "PWGTP16"    "PWGTP17"   
[176] "PWGTP18"    "PWGTP19"    "PWGTP20"    "PWGTP21"    "PWGTP22"   
[181] "PWGTP23"    "PWGTP24"    "PWGTP25"    "PWGTP26"    "PWGTP27"   
[186] "PWGTP28"    "PWGTP29"    "PWGTP30"    "PWGTP31"    "PWGTP32"   
[191] "PWGTP33"    "PWGTP34"    "PWGTP35"    "PWGTP36"    "PWGTP37"   
[196] "PWGTP38"    "PWGTP39"    "PWGTP40"    "PWGTP41"    "PWGTP42"   
[201] "PWGTP43"    "PWGTP44"    "PWGTP45"    "PWGTP46"    "PWGTP47"   
[206] "PWGTP48"    "PWGTP49"    "PWGTP50"    "PWGTP51"    "PWGTP52"   
[211] "PWGTP53"    "PWGTP54"    "PWGTP55"    "PWGTP56"    "PWGTP57"   
[216] "PWGTP58"    "PWGTP59"    "PWGTP60"    "PWGTP61"    "PWGTP62"   
[221] "PWGTP63"    "PWGTP64"    "PWGTP65"    "PWGTP66"    "PWGTP67"   
[226] "PWGTP68"    "PWGTP69"    "PWGTP70"    "PWGTP71"    "PWGTP72"   
[231] "PWGTP73"    "PWGTP74"    "PWGTP75"    "PWGTP76"    "PWGTP77"   
[236] "PWGTP78"    "PWGTP79"    "PWGTP80"    "NOP"        "ADJINC"    
[241] "CITWP"      "DEAR"       "DRAT"       "DRATX"      "HINS1"     
[246] "HINS2"      "HINS3"      "HINS4"      "HINS5"      "HINS6"     
[251] "HINS7"      "MARHD"      "MARHM"      "MARHT"      "MARHW"     
[256] "MARHYP"     "DIS"        "HICOV"      "PRIVCOV"    "PUBCOV"    
[261] "FCITWP"     "FDEARP"     "FDRATP"     "FDRATXP"    "FHINS1P"   
[266] "FHINS2P"    "FHINS3P"    "FHINS4P"    "FHINS5P"    "FHINS6P"   
[271] "FHINS7P"    "FMARHDP"    "FMARHMP"    "FMARHTP"    "FMARHWP"   
[276] "FMARHYP"    "WRK"        "FOD1P"      "FOD2P"      "SCIENGP"   
[281] "SCIENGRLP"  "FFODP"      "FHINS3C"    "FHINS4C"    "FHINS5C"   
[286] "RELP"       "FWRKP"      "FDISP"      "FPERNP"     "FPINCP"    
[291] "FPRIVCOVP"  "FPUBCOVP"   "RACNH"      "RACPI"      "SSPA"      
[296] "MLPCD"      "MLPFG"      "FHICOVP"    "DIVISION"   "REGION"    
[301] "HIMRKS"     "JWTRNS"     "RELSHIPP"   "WKWN"       "FHIMRKSP"  
[306] "FJWTRNSP"   "FRELSHIPP"  "FWKWNP"     "MLPIK"      "year"      
[311] "location"   "age_groups" "ins_type"   "age_decade"

What creates a copy besides copy()


  1. When you subset the data (select columns or filter rows)
  2. Change a data.table to a data.frame or tibble
  3. Aggregate or summarizing of the data.table

4. API Lifecycle Management

“I’m not superstitious, but I am a little stitious.”


Stable and backward compatible

Key principles:

  • Backward compatibility maintained
  • New features don’t break existing code
  • Clear deprecation warnings when needed

5. Community

Active development and strong ecosystem

  • New Governance: As part of a NSF grant, new expansive governance
  • GitHub: 3,500+ stars, active issues and PRs
  • CRAN: Over 2,000 reverse dependencies
  • Stack Overflow: 15,000+ questions tagged with data.table
  • Documentation: Comprehensive vignettes and examples
  • Extensions: dtplyr, data.table.express, tidyfast, tidytable, and more
# Getting help
?data.table
vignette("datatable-intro")
browseVignettes("data.table")

6. Feature Rich

Comprehensive data manipulation toolkit

Joins

# Load household data for comparison
household_data <- open_dataset(here::here("data/household")) |>
  filter(year >= 2020, location %in% c("ca", "tx", "ny")) |>
  collect()
setDT(household_data)

# Create state-year summary from household data
household_summary <- household_data[, 
  .(avg_income = mean(HINCP, na.rm = TRUE)), 
  by = .(ST, year)
]

# Join person and household summaries
pums[household_summary, on = c("ST", "year")] # merge(pums, household_summary, by = c("ST", "year"))
            id            RT      SERIALNO   PUMA          ST ADJUST PWGTP
         <int>        <fctr>        <char> <char>      <char>  <int> <int>
      1:     1 Person Record 2021HU0896827  00904 New York/NY     NA   179
      2:     2 Person Record 2021HU0896827  00904 New York/NY     NA   182
      3:     3 Person Record 2021HU0896827  00904 New York/NY     NA   199
      4:     4 Person Record 2021HU0896827  00904 New York/NY     NA   197
      5:     5 Person Record 2021HU0896827  00904 New York/NY     NA   229
     ---                                                                  
1735551:     1 Person Record 2022HU0609672  04611    Texas/TX     NA   136
1735552:     2 Person Record 2022HU0609672  04611    Texas/TX     NA   140
1735553:     3 Person Record 2022HU0609672  04611    Texas/TX     NA   167
1735554:     1 Person Record 2022HU0609675  04302    Texas/TX     NA    20
1735555:     2 Person Record 2022HU0609675  04302    Texas/TX     NA    33
          AGEP                            CIT
         <int>                         <fctr>
      1:    60 U.S. citizen by naturalization
      2:    40 U.S. citizen by naturalization
      3:    34 U.S. citizen by naturalization
      4:    26 U.S. citizen by naturalization
      5:    20      Born in the United States
     ---                                     
1735551:    56 U.S. citizen by naturalization
1735552:    67 U.S. citizen by naturalization
1735553:    21      Born in the United States
1735554:    66      Born in the United States
1735555:    64      Born in the United States
                                                                                                       COW
                                                                                                    <fctr>
      1:                      Employee of a private not-for-profit, tax-exempt, or charitable organization
      2:                                                                                              <NA>
      3:                      Employee of a private not-for-profit, tax-exempt, or charitable organization
      4: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
      5: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
     ---                                                                                                  
1735551: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
1735552: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
1735553: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
1735554:                                                                                              <NA>
1735555: Employee of a private for-profit co. or bus., or of an individual, for wages, salary, commissions
           DDRS   DEYE   DOUT   DPHY   DREM   DWRK       ENG    FER    GCL
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>    <fctr> <lgcl> <lgcl>
      1:  FALSE  FALSE  FALSE  FALSE  FALSE     NA      Well     NA  FALSE
      2:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  Not well  FALSE  FALSE
      3:  FALSE  FALSE  FALSE  FALSE  FALSE     NA      Well     NA  FALSE
      4:  FALSE  FALSE  FALSE  FALSE  FALSE     NA      Well     NA     NA
      5:  FALSE  FALSE  FALSE  FALSE  FALSE     NA      Well     NA     NA
     ---                                                                  
1735551:  FALSE  FALSE  FALSE  FALSE   TRUE     NA      Well     NA  FALSE
1735552:  FALSE  FALSE  FALSE  FALSE  FALSE     NA      Well     NA  FALSE
1735553:  FALSE  FALSE  FALSE  FALSE  FALSE     NA Very well  FALSE     NA
1735554:   TRUE  FALSE   TRUE   TRUE   TRUE     NA      <NA>     NA  FALSE
1735555:  FALSE  FALSE  FALSE   TRUE   TRUE     NA      <NA>     NA  FALSE
            GCM    GCR  INTP JWMNP  JWRIP   JWTR   LANX
         <fctr> <lgcl> <int> <int> <char> <char> <lgcl>
      1:   <NA>     NA     0    30      1   <NA>   TRUE
      2:   <NA>     NA     0    NA   <NA>   <NA>   TRUE
      3:   <NA>     NA   290    10      1   <NA>   TRUE
      4:   <NA>     NA     0     5      1   <NA>   TRUE
      5:   <NA>     NA     0    12      1   <NA>   TRUE
     ---                                               
1735551:   <NA>     NA -2400    40      1   <NA>   TRUE
1735552:   <NA>     NA     0    30      1   <NA>   TRUE
1735553:   <NA>     NA     0    20      1   <NA>   TRUE
1735554:   <NA>     NA     0    NA   <NA>   <NA>  FALSE
1735555:   <NA>     NA     0    30      1   <NA>  FALSE
                                         MAR    MIG
                                      <fctr> <lgcl>
      1:                             Married   TRUE
      2:                             Married   TRUE
      3: Never married or under 15 years old   TRUE
      4: Never married or under 15 years old   TRUE
      5: Never married or under 15 years old   TRUE
     ---                                           
1735551:                             Married   TRUE
1735552:                             Married   TRUE
1735553: Never married or under 15 years old   TRUE
1735554:                             Married   TRUE
1735555:                             Married   TRUE
                                  MIL   MILY   MLPA   MLPB   MLPC   MLPD   MLPE
                               <fctr> <fctr> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1: Never served in the military   <NA>     NA     NA     NA     NA     NA
      2: Never served in the military   <NA>     NA     NA     NA     NA     NA
      3: Never served in the military   <NA>     NA     NA     NA     NA     NA
      4: Never served in the military   <NA>     NA     NA     NA     NA     NA
      5: Never served in the military   <NA>     NA     NA     NA     NA     NA
     ---                                                                       
1735551: Never served in the military   <NA>     NA     NA     NA     NA     NA
1735552: Never served in the military   <NA>     NA     NA     NA     NA     NA
1735553: Never served in the military   <NA>     NA     NA     NA     NA     NA
1735554: Never served in the military   <NA>     NA     NA     NA     NA     NA
1735555: Never served in the military   <NA>     NA     NA     NA     NA     NA
           MLPF   MLPG   MLPH   MLPI   MLPJ   MLPK   NWAB              NWAV
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>            <fctr>
      1:     NA     NA     NA     NA     NA     NA     NA    Did not report
      2:     NA     NA     NA     NA     NA     NA  FALSE    Did not report
      3:     NA     NA     NA     NA     NA     NA     NA    Did not report
      4:     NA     NA     NA     NA     NA     NA     NA    Did not report
      5:     NA     NA     NA     NA     NA     NA     NA    Did not report
     ---                                                                   
1735551:     NA     NA     NA     NA     NA     NA     NA    Did not report
1735552:     NA     NA     NA     NA     NA     NA     NA    Did not report
1735553:     NA     NA     NA     NA     NA     NA     NA    Did not report
1735554:     NA     NA     NA     NA     NA     NA  FALSE No, other reasons
1735555:     NA     NA     NA     NA     NA     NA  FALSE               Yes
           NWLA   NWLK   NWRE   OIP   PAP    REL  RETP    SCH
         <lgcl> <lgcl> <lgcl> <int> <int> <char> <int> <lgcl>
      1:     NA     NA     NA  3300  3300   <NA>     0  FALSE
      2:  FALSE  FALSE     NA     0     0   <NA>     0  FALSE
      3:     NA     NA     NA     0     0   <NA>     0  FALSE
      4:     NA     NA     NA     0     0   <NA>     0  FALSE
      5:     NA     NA     NA     0     0   <NA>     0  FALSE
     ---                                                     
1735551:     NA     NA     NA     0     0   <NA>     0  FALSE
1735552:     NA     NA     NA     0     0   <NA>     0  FALSE
1735553:     NA     NA     NA     0     0   <NA>     0   TRUE
1735554:  FALSE  FALSE  FALSE     0     0   <NA>     0  FALSE
1735555:  FALSE  FALSE     NA     0     0   <NA>     0  FALSE
                                                     SCHG
                                                   <char>
      1:                                             <NA>
      2:                                             <NA>
      3:                                             <NA>
      4:                                             <NA>
      5:                                             <NA>
     ---                                                 
1735551:                                             <NA>
1735552:                                             <NA>
1735553: College undergraduate years (freshman to senior)
1735554:                                             <NA>
1735555:                                             <NA>
                                                 SCHL  SEMP    SEX  SSIP   SSP
                                               <char> <int> <fctr> <int> <int>
      1:                           Associate's degree     0   Male     0     0
      2:                  Regular high school diploma     0 Female     0     0
      3:                           Associate's degree     0   Male     0     0
      4:                  Regular high school diploma     0   Male     0     0
      5:                  Regular high school diploma     0   Male     0     0
     ---                                                                      
1735551:                            Bachelor's degree     0 Female     0     0
1735552:                  Regular high school diploma     0   Male     0     0
1735553: 1 or more years of college credit, no degree     0 Female     0     0
1735554:           Some college, but less than 1 year     0   Male  3600 30100
1735555:                  Regular high school diploma 12100 Female     0     0
          WAGP  WKHP                              WKL    WKW   YOEP   UWRK
         <int> <int>                           <fctr> <fctr> <char> <lgcl>
      1: 68000    40        Within the past 12 months   <NA>   1990     NA
      2:     0    NA Over 5 years ago or never worked   <NA>   2012     NA
      3: 36000    32        Within the past 12 months   <NA>   2004     NA
      4: 40000    40        Within the past 12 months   <NA>   1998     NA
      5: 12000    30        Within the past 12 months   <NA>   <NA>     NA
     ---                                                                  
1735551: 30000    40        Within the past 12 months   <NA>   1975     NA
1735552: 50000    40        Within the past 12 months   <NA>   1957     NA
1735553: 18000    20        Within the past 12 months   <NA>   <NA>     NA
1735554:     0    NA Over 5 years ago or never worked   <NA>   <NA>     NA
1735555: 30100    40        Within the past 12 months   <NA>   <NA>     NA
            ANC      ANC1P        ANC2P        DECADE
         <fctr>     <char>       <char>        <fctr>
      1: Single     Yemeni Not reported   1990 - 1999
      2: Single     Yemeni Not reported 2010 or later
      3: Single     Yemeni Not reported   2000 - 2009
      4: Single     Yemeni Not reported   1990 - 1999
      5: Single     Yemeni Not reported          <NA>
     ---                                             
1735551: Single    Chinese Not reported   1970 - 1979
1735552: Single Vietnamese Not reported   1950 - 1959
1735553: Single Vietnamese Not reported          <NA>
1735554: Single      White Not reported          <NA>
1735555: Single    Mexican Not reported          <NA>
                              DRIVESP     DS    ESP                        ESR
                               <fctr> <lgcl> <fctr>                     <fctr>
      1: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
      2:                         <NA>     NA   <NA>         Not in Labor Force
      3: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
      4: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
      5: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
     ---                                                                      
1735551: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
1735552: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
1735553: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
1735554:                         <NA>     NA   <NA>         Not in Labor Force
1735555: 1.000 vehicles (Drove alone)     NA   <NA> Civilian employed, at work
                                HISP
                              <char>
      1: Not Spanish/Hispanic/Latino
      2: Not Spanish/Hispanic/Latino
      3: Not Spanish/Hispanic/Latino
      4: Not Spanish/Hispanic/Latino
      5: Not Spanish/Hispanic/Latino
     ---                            
1735551: Not Spanish/Hispanic/Latino
1735552: Not Spanish/Hispanic/Latino
1735553: Not Spanish/Hispanic/Latino
1735554: Not Spanish/Hispanic/Latino
1735555:                     Mexican
                                                                                                                 INDP
                                                                                                               <char>
      1: MED-General Medical And Surgical Hospitals, And Specialty (Except Psychiatric And Substance Abuse) Hospitals
      2:                                                                                                         <NA>
      3:                                                                           SCA-Individual And Family Services
      4:                                                        MFG-Knitting Fabric Mills, And Apparel Knitting Mills
      5:                                               RET-Supermarkets and Other Grocery (Except Convenience) Stores
     ---                                                                                                             
1735551:                                                                           FIN-Banking And Related Activities
1735552:                                                                                       RET-Automobile Dealers
1735553:                                   RET-General Merchandise Stores, Including Warehouse Clubs and Supercenters
1735554:                                                                                                         <NA>
1735555:                                                                         EDU-Elementary And Secondary Schools
                             JWAP                     JWDP       LANP MIGPUMA
                           <char>                   <char>     <char>  <fctr>
      1:   9:00 a.m. to 9:04 a.m.   8:30 a.m. to 8:34 a.m.     Arabic    <NA>
      2:                     <NA>                     <NA>     Arabic    <NA>
      3:   8:10 a.m. to 8:14 a.m.   8:00 a.m. to 8:04 a.m.     Arabic    <NA>
      4:   8:05 a.m. to 8:09 a.m.   8:00 a.m. to 8:04 a.m.     Arabic    <NA>
      5:   7:10 a.m. to 7:14 a.m.   7:00 a.m. to 7:04 a.m.     Arabic    <NA>
     ---                                                                     
1735551:   7:55 a.m. to 7:59 a.m.   7:15 a.m. to 7:19 a.m. Vietnamese    <NA>
1735552:   7:30 a.m. to 7:34 a.m.   7:00 a.m. to 7:04 a.m. Vietnamese    <NA>
1735553: 11:50 a.m. to 11:54 a.m. 11:30 a.m. to 11:39 a.m. Vietnamese    <NA>
1735554:                     <NA>                     <NA>       <NA>    <NA>
1735555:   7:00 a.m. to 7:04 a.m.   6:30 a.m. to 6:34 a.m.       <NA>    <NA>
          MIGSP                         MSP
         <char>                      <fctr>
      1:   <NA> Now Married, Spouse Present
      2:   <NA> Now Married, Spouse Present
      3:   <NA>               Never Married
      4:   <NA>               Never Married
      5:   <NA>               Never Married
     ---                                   
1735551:   <NA> Now Married, Spouse Present
1735552:   <NA> Now Married, Spouse Present
1735553:   <NA>               Never Married
1735554:   <NA> Now Married, Spouse Present
1735555:   <NA> Now Married, Spouse Present
                                                                                                               NAICSP
                                                                                                               <char>
      1: MED-General Medical And Surgical Hospitals, And Specialty (Except Psychiatric And Substance Abuse) Hospitals
      2:                                                                                                         <NA>
      3:                                                                           SCA-Individual And Family Services
      4:                                                        MFG-Knitting Fabric Mills, And Apparel Knitting Mills
      5:                                               RET-Supermarkets And Other Grocery (Except Convenience) Stores
     ---                                                                                                             
1735551:                                                                           FIN-Banking And Related Activities
1735552:                                                                                       RET-Automobile Dealers
1735553:                                   RET-General Merchandise Stores, Including Warehouse Clubs and Supercenters
1735554:                                                                                                         <NA>
1735555:                                                                         EDU-Elementary And Secondary Schools
             NATIVITY     OC                                             OCCP
               <fctr> <lgcl>                                           <char>
      1: Foreign born     NA               EDU-Other Teachers and Instructors
      2: Foreign born     NA                                             <NA>
      3: Foreign born     NA                          HLS-Personal Care Aides
      4: Foreign born     NA       CON-Other Construction And Related Workers
      5:       Native     NA                   TRN-Stockers And Order Fillers
     ---                                                                     
1735551: Foreign born     NA                                      OFF-Tellers
1735552: Foreign born     NA RPR-Automotive Service Technicians And Mechanics
1735553:       Native     NA                         MED-Pharmacy Technicians
1735554:       Native     NA                                             <NA>
1735555:       Native     NA                          EDU-Teaching Assistants
                                                 PAOC PERNP PINCP         POBP
                                               <fctr> <int> <int>       <char>
      1:                                         <NA> 68000 74600        Yemen
      2: Females with own children under 6 years only     0     0        Yemen
      3:                                         <NA> 36000 36290        Yemen
      4:                                         <NA> 40000 40000        Yemen
      5:                                         <NA> 12000 12000  New York/NY
     ---                                                                      
1735551:                 Females with no own children 30000 27600      Vietnam
1735552:                                         <NA> 50000 50000      Vietnam
1735553:                 Females with no own children 18000 18000     Texas/TX
1735554:                                         <NA>     0 33700 Minnesota/MN
1735555:                 Females with no own children 42200 42200     Texas/TX
         POVPIP POWPUMA       POWSP                   QTRBIR
          <int>  <fctr>      <char>                   <fctr>
      1:    386    <NA> New York/NY       April through June
      2:    386    <NA>        <NA>    January through March
      3:    386    <NA> New York/NY       April through June
      4:    386    <NA> New York/NY   July through September
      5:    386    <NA> New York/NY October through December
     ---                                                    
1735551:    419    <NA>    Texas/TX October through December
1735552:    419    <NA>    Texas/TX       April through June
1735553:    419    <NA>    Texas/TX    January through March
1735554:    431    <NA>        <NA>       April through June
1735555:    431    <NA>    Texas/TX       April through June
                         RAC1P                 RAC2P                 RAC3P
                        <fctr>                <char>                <char>
      1:           White alone           White alone           White alone
      2:           White alone           White alone           White alone
      3:           White alone           White alone           White alone
      4:           White alone           White alone           White alone
      5:           White alone           White alone           White alone
     ---                                                                  
1735551:           Asian alone      Vietnamese alone      Vietnamese alone
1735552:           Asian alone      Vietnamese alone      Vietnamese alone
1735553:           Asian alone      Vietnamese alone      Vietnamese alone
1735554:           White alone           White alone           White alone
1735555: Some other race alone Some Other Race alone Some Other Race alone
         RACAIAN RACASN RACBLK RACNHPI RACNUM RACSOR RACWHT     RC    SFN
          <lgcl> <lgcl> <lgcl>  <lgcl>  <int> <lgcl> <lgcl> <lgcl> <fctr>
      1:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
      2:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
      3:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
      4:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
      5:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
     ---                                                                 
1735551:   FALSE   TRUE  FALSE      NA      1  FALSE  FALSE     NA   <NA>
1735552:   FALSE   TRUE  FALSE      NA      1  FALSE  FALSE     NA   <NA>
1735553:   FALSE   TRUE  FALSE      NA      1  FALSE  FALSE     NA   <NA>
1735554:   FALSE  FALSE  FALSE      NA      1  FALSE   TRUE     NA   <NA>
1735555:   FALSE  FALSE  FALSE      NA      1   TRUE  FALSE     NA   <NA>
            SFR                                             SOCP    VPS
         <fctr>                                           <char> <char>
      1:   <NA>               EDU-Other Teachers And Instructors   <NA>
      2:   <NA>                                             <NA>   <NA>
      3:   <NA>                          HLS-Personal Care Aides   <NA>
      4:   <NA>       CON-Other Construction And Related Workers   <NA>
      5:   <NA>                   TRN-Stockers And Order Fillers   <NA>
     ---                                                               
1735551:   <NA>                                      OFF-Tellers   <NA>
1735552:   <NA> RPR-Automotive Service Technicians And Mechanics   <NA>
1735553:   <NA>                         MED-Pharmacy Technicians   <NA>
1735554:   <NA>                                             <NA>   <NA>
1735555:   <NA>                          EDU-Teaching Assistants   <NA>
                                      WAOB  FAGEP  FANCP  FCITP  FCOWP FDDRSP
                                    <fctr> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE  FALSE   TRUE  FALSE
      2: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE   TRUE  FALSE  FALSE
      3: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE  FALSE   TRUE  FALSE
      4: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE  FALSE   TRUE  FALSE
      5:         US state (POBP = 001-059)  FALSE  FALSE  FALSE   TRUE  FALSE
     ---                                                                     
1735551: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE  FALSE  FALSE  FALSE
1735552: Asia (POBP = 158-159,161,200-299)  FALSE  FALSE  FALSE  FALSE  FALSE
1735553:         US state (POBP = 001-059)  FALSE  FALSE  FALSE  FALSE  FALSE
1735554:         US state (POBP = 001-059)  FALSE  FALSE  FALSE  FALSE  FALSE
1735555:         US state (POBP = 001-059)  FALSE  FALSE  FALSE  FALSE  FALSE
         FDEYEP FDOUTP FDPHYP FDREMP FDWRKP  FENGP  FESRP  FFERP  FGCLP  FGCMP
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
      2:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
      3:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
      4:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
      5:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
     ---                                                                      
1735551:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
1735552:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
1735553:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
1735554:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
1735555:  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE
          FGCRP  FHISP  FINDP  FINTP  FJWDP FJWMNP FJWRIP FJWTRP  FLANP FLANXP
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1:  FALSE  FALSE   TRUE   TRUE   TRUE   TRUE   TRUE     NA  FALSE  FALSE
      2:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE
      3:  FALSE  FALSE   TRUE   TRUE   TRUE   TRUE   TRUE     NA  FALSE  FALSE
      4:  FALSE  FALSE   TRUE   TRUE   TRUE   TRUE   TRUE     NA  FALSE  FALSE
      5:  FALSE  FALSE   TRUE   TRUE   TRUE   TRUE   TRUE     NA  FALSE  FALSE
     ---                                                                      
1735551:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE
1735552:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE
1735553:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE
1735554:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE
1735555:  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE   TRUE
          FMARP  FMIGP FMIGSP FMILPP FMILSP FMILYP  FOCCP   FOIP   FPAP  FPOBP
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1:  FALSE  FALSE  FALSE  FALSE  FALSE     NA   TRUE   TRUE   TRUE  FALSE
      2:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
      3:  FALSE  FALSE  FALSE  FALSE  FALSE     NA   TRUE   TRUE   TRUE  FALSE
      4:  FALSE  FALSE  FALSE  FALSE  FALSE     NA   TRUE   TRUE   TRUE  FALSE
      5:  FALSE  FALSE  FALSE  FALSE  FALSE     NA   TRUE   TRUE   TRUE  FALSE
     ---                                                                      
1735551:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
1735552:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
1735553:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
1735554:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
1735555:  FALSE  FALSE  FALSE  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE
         FPOWSP  FRACP  FRELP  FRETP FSCHGP FSCHLP  FSCHP  FSEMP  FSEXP  FSSIP
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1:   TRUE  FALSE     NA   TRUE  FALSE  FALSE  FALSE   TRUE  FALSE   TRUE
      2:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
      3:   TRUE  FALSE     NA   TRUE  FALSE  FALSE  FALSE   TRUE  FALSE   TRUE
      4:   TRUE  FALSE     NA   TRUE  FALSE  FALSE  FALSE   TRUE  FALSE   TRUE
      5:   TRUE  FALSE     NA   TRUE  FALSE  FALSE  FALSE   TRUE  FALSE   TRUE
     ---                                                                      
1735551:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
1735552:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
1735553:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
1735554:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE   TRUE
1735555:  FALSE  FALSE     NA  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
           FSSP  FWAGP  FWKHP  FWKLP  FWKWP  FYOEP PWGTP1 PWGTP2 PWGTP3 PWGTP4
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>  <int>  <int>  <int>  <int>
      1:   TRUE   TRUE   TRUE   TRUE     NA  FALSE    266    197     50    300
      2:  FALSE  FALSE  FALSE  FALSE     NA   TRUE    291    172     54    322
      3:   TRUE   TRUE   TRUE   TRUE     NA   TRUE    270    192     54    353
      4:   TRUE   TRUE   TRUE   TRUE     NA   TRUE    311    211     57    307
      5:   TRUE   TRUE   TRUE   TRUE     NA  FALSE    305    237     66    466
     ---                                                                      
1735551:  FALSE  FALSE  FALSE  FALSE     NA   TRUE     35    231    139    217
1735552:  FALSE  FALSE  FALSE  FALSE     NA   TRUE     41    236    143    221
1735553:  FALSE  FALSE  FALSE  FALSE     NA  FALSE     50    285    180    237
1735554:  FALSE  FALSE  FALSE  FALSE     NA  FALSE      5     31      6     16
1735555:  FALSE  FALSE  FALSE  FALSE     NA  FALSE      6     65      9     27
         PWGTP5 PWGTP6 PWGTP7 PWGTP8 PWGTP9 PWGTP10 PWGTP11 PWGTP12 PWGTP13
          <int>  <int>  <int>  <int>  <int>   <int>   <int>   <int>   <int>
      1:    191    287    190     57    152      56     283     170      54
      2:    172    282    197     55    169      57     304     167      61
      3:    228    317    189     59    173      71     294     184      63
      4:    211    274    203     63    159      69     293     189      65
      5:    211    358    235     66    186      95     385     221      62
     ---                                                                   
1735551:    149     36    153     44    198     123      40      42     139
1735552:    157     35    139     41    196     132      44      46     151
1735553:    179     46    206     54    250     133      50      53     167
1735554:     25     28     31     41     23      16       5      40      17
1735555:     45     42     64     52     35      28       7      49      31
         PWGTP14 PWGTP15 PWGTP16 PWGTP17 PWGTP18 PWGTP19 PWGTP20 PWGTP21
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:      54     177     169     180     197     179      57      54
      2:      57     163     169     184     212     192      58      52
      3:      60     164     179     200     223     218      66      60
      4:      71     187     179     222     198     217      62      66
      5:      76     204     205     249     243     219      79      80
     ---                                                                
1735551:     160     130     142     117     170     162      53     187
1735552:     152     141     161     117     183     168      53     216
1735553:     178     152     187     142     212     232      54     267
1735554:       5      23      22      24      17       6       6      26
1735555:      10      30      33      40      25      10      12      38
         PWGTP22 PWGTP23 PWGTP24 PWGTP25 PWGTP26 PWGTP27 PWGTP28 PWGTP29
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     185     280      58     187      59     164     296     184
      2:     190     313      56     176      60     186     275     189
      3:     213     313      76     204      63     186     294     225
      4:     218     278      66     210      67     196     304     194
      5:     230     314      84     226      71     217     389     234
     ---                                                                
1735551:      49     134      40     179     218     141     198      36
1735552:      53     141      42     169     206     139     208      36
1735553:      70     164      38     202     218     167     256      40
1735554:      19      25      29       6      18      18      16      34
1735555:      26      47      46      10      46      27      28      63
         PWGTP30 PWGTP31 PWGTP32 PWGTP33 PWGTP34 PWGTP35 PWGTP36 PWGTP37
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     295      56     166     338     295     180     189     165
      2:     290      57     180     332     312     175     180     165
      3:     303      67     224     346     350     213     206     172
      4:     289      74     224     353     322     186     180     191
      5:     343      89     207     358     335     249     257     245
     ---                                                                
1735551:     127     224     190     132     141     141     161     138
1735552:     129     231     203     137     126     145     172     129
1735553:     172     278     243     197     177     177     204     153
1735554:       6      16      21      34      19      40      34       7
1735555:      13      25      41      89      33      58      59      12
         PWGTP38 PWGTP39 PWGTP40 PWGTP41 PWGTP42 PWGTP43 PWGTP44 PWGTP45
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     176     174     297     274     159      56     280     193
      2:     179     185     301     272     161      64     268     176
      3:     202     190     298     298     187      59     282     214
      4:     191     180     302     298     200      55     345     271
      5:     230     231     335     388     170      70     353     274
     ---                                                                
1735551:      33     163     275      41     221     141     210     131
1735552:      35     156     288      39     248     140     209     142
1735553:      41     188     336      46     263     164     255     156
1735554:       5      22      20       6      40       8      16      18
1735555:       7      38      34       8      54       8      27      42
         PWGTP46 PWGTP47 PWGTP48 PWGTP49 PWGTP50 PWGTP51 PWGTP52 PWGTP53
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     282     164      54     155      56     286     180      53
      2:     276     168      56     180      60     278     198      52
      3:     338     190      60     165      70     287     216      66
      4:     303     194      52     194      68     301     174      53
      5:     374     167      76     211      72     327     203      73
     ---                                                                
1735551:      38     154      47     230     121      41      34     107
1735552:      40     159      45     223     140      44      35     105
1735553:      48     181      59     240     151      47      41     143
1735554:      33      31      29      22      17       5      37      17
1735555:      61      54      43      33      19       9      77      31
         PWGTP54 PWGTP55 PWGTP56 PWGTP57 PWGTP58 PWGTP59 PWGTP60 PWGTP61
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:      55     178     170     194     196     209      51      56
      2:      56     184     178     207     180     206      52      58
      3:      60     222     191     193     218     225      56      64
      4:      66     184     190     210     196     220      57      59
      5:      66     210     239     266     222     217      66      83
     ---                                                                
1735551:     145     156     142     145     209     141      41     201
1735552:     144     156     151     154     196     152      50     209
1735553:     179     175     196     158     249     211      58     300
1735554:       5      20      21      18      18       8       7      23
1735555:      10      50      28      29      31      13      11      50
         PWGTP62 PWGTP63 PWGTP64 PWGTP65 PWGTP66 PWGTP67 PWGTP68 PWGTP69
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     191     308      53     180      55     182     299     193
      2:     192     304      63     194      57     188     316     189
      3:     203     320      63     190      67     212     296     240
      4:     241     316      64     198      59     184     291     216
      5:     271     350      75     245      82     237     385     225
     ---                                                                
1735551:      46     148      39     127     193     121     255      38
1735552:      49     158      37     134     192     130     268      41
1735553:      64     167      40     181     233     162     327      49
1735554:      15      19      29       5      21      26      20      32
1735555:      22      36      37       9      40      39      25      47
         PWGTP70 PWGTP71 PWGTP72 PWGTP73 PWGTP74 PWGTP75 PWGTP76 PWGTP77
           <int>   <int>   <int>   <int>   <int>   <int>   <int>   <int>
      1:     270      57     190     303     311     171     176     181
      2:     291      54     189     306     295     172     170     185
      3:     265      57     220     307     339     217     207     225
      4:     310      60     208     309     412     197     168     218
      5:     331      80     247     355     426     224     217     264
     ---                                                                
1735551:     124     208     208     124     139     172     156     151
1735552:     135     193     212     123     128     159     169     186
1735553:     150     277     220     174     172     183     227     208
1735554:       4      16      21      40      20      36      42       7
1735555:       8      30      52      67      32      82      67      16
         PWGTP78 PWGTP79 PWGTP80    NOP   ADJINC  CITWP   DEAR   DRAT  DRATX
           <int>   <int>   <int> <fctr>    <num> <char> <lgcl> <fctr> <lgcl>
      1:     179     178     305   <NA> 1.029928   2007  FALSE   <NA>     NA
      2:     171     185     283   <NA> 1.029928   2018  FALSE   <NA>     NA
      3:     192     201     322   <NA> 1.029928   2014  FALSE   <NA>     NA
      4:     240     194     265   <NA> 1.029928   2005  FALSE   <NA>     NA
      5:     252     212     316   <NA> 1.029928   <NA>  FALSE   <NA>     NA
     ---                                                                    
1735551:      43     130     245   <NA> 1.042311   1989  FALSE   <NA>     NA
1735552:      42     138     275   <NA> 1.042311   1993  FALSE   <NA>     NA
1735553:      50     158     344   <NA> 1.042311   <NA>  FALSE   <NA>     NA
1735554:       5      19      22   <NA> 1.042311   <NA>   TRUE   <NA>     NA
1735555:       9      46      44   <NA> 1.042311   <NA>  FALSE   <NA>     NA
          HINS1  HINS2  HINS3  HINS4  HINS5  HINS6  HINS7  MARHD  MARHM
         <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl> <lgcl>
      1:  FALSE   TRUE  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE
      2:  FALSE   TRUE  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE
      3:  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE     NA     NA
      4:  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE     NA     NA
      5:  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE     NA     NA
     ---                                                               
1735551:   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
1735552:   TRUE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
1735553:  FALSE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE     NA     NA
1735554:   TRUE  FALSE   TRUE   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE
1735555:   TRUE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE  FALSE
            MARHT  MARHW MARHYP    DIS  HICOV PRIVCOV PUBCOV FCITWP FDEARP
           <fctr> <lgcl> <char> <lgcl> <lgcl>  <lgcl> <lgcl> <lgcl> <lgcl>
      1: One time  FALSE   2009  FALSE   TRUE    TRUE   TRUE  FALSE  FALSE
      2: One time  FALSE   2009  FALSE   TRUE    TRUE   TRUE   TRUE  FALSE
      3:     <NA>     NA   <NA>  FALSE   TRUE    TRUE  FALSE   TRUE  FALSE
      4:     <NA>     NA   <NA>  FALSE   TRUE    TRUE  FALSE  FALSE  FALSE
      5:     <NA>     NA   <NA>  FALSE   TRUE    TRUE  FALSE  FALSE  FALSE
     ---                                                                  
1735551: One time  FALSE   1998   TRUE   TRUE    TRUE  FALSE  FALSE  FALSE
1735552: One time  FALSE   1998  FALSE   TRUE    TRUE  FALSE  FALSE  FALSE
1735553:     <NA>     NA   <NA>  FALSE   TRUE    TRUE  FALSE  FALSE  FALSE
1735554: One time  FALSE   1974   TRUE   TRUE    TRUE   TRUE  FALSE  FALSE
1735555: One time  FALSE   1974   TRUE   TRUE    TRUE  FALSE  FALSE  FALSE
         FDRATP FDRATXP FHINS1P FHINS2P FHINS3P FHINS4P FHINS5P FHINS6P FHINS7P
         <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl>
      1:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
      2:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
      3:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
      4:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
      5:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
     ---                                                                       
1735551:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
1735552:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
1735553:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
1735554:  FALSE   FALSE   FALSE    TRUE   FALSE   FALSE    TRUE    TRUE    TRUE
1735555:  FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE   FALSE
         FMARHDP FMARHMP FMARHTP FMARHWP FMARHYP    WRK            FOD1P  FOD2P
          <lgcl>  <lgcl>  <lgcl>  <lgcl>  <lgcl> <lgcl>           <char> <char>
      1:   FALSE   FALSE    TRUE   FALSE    TRUE   TRUE             <NA>   <NA>
      2:   FALSE   FALSE    TRUE   FALSE    TRUE  FALSE             <NA>   <NA>
      3:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
      4:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
      5:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
     ---                                                                       
1735551:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE General Business   <NA>
1735552:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
1735553:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
1735554:   FALSE   FALSE   FALSE   FALSE   FALSE  FALSE             <NA>   <NA>
1735555:   FALSE   FALSE   FALSE   FALSE   FALSE   TRUE             <NA>   <NA>
         SCIENGP SCIENGRLP  FFODP FHINS3C FHINS4C FHINS5C   RELP  FWRKP  FDISP
          <lgcl>    <lgcl> <lgcl>  <fctr>  <fctr>  <fctr> <char> <lgcl> <lgcl>
      1:      NA        NA  FALSE    <NA>     Yes    <NA>   <NA>  FALSE  FALSE
      2:      NA        NA  FALSE    <NA>     Yes    <NA>   <NA>  FALSE  FALSE
      3:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
      4:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
      5:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
     ---                                                                      
1735551:   FALSE     FALSE  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
1735552:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
1735553:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
1735554:      NA        NA  FALSE      No     Yes    <NA>   <NA>  FALSE  FALSE
1735555:      NA        NA  FALSE    <NA>    <NA>    <NA>   <NA>  FALSE  FALSE
         FPERNP FPINCP FPRIVCOVP FPUBCOVP  RACNH  RACPI   SSPA  MLPCD  MLPFG
         <lgcl> <lgcl>    <lgcl>   <lgcl> <lgcl> <lgcl> <fctr> <lgcl> <lgcl>
      1:   TRUE   TRUE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
      2:  FALSE  FALSE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
      3:   TRUE   TRUE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
      4:   TRUE   TRUE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
      5:   TRUE   TRUE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
     ---                                                                    
1735551:  FALSE  FALSE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
1735552:  FALSE  FALSE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
1735553:  FALSE  FALSE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
1735554:  FALSE   TRUE      TRUE     TRUE  FALSE  FALSE   <NA>     NA     NA
1735555:  FALSE  FALSE     FALSE    FALSE  FALSE  FALSE   <NA>     NA     NA
         FHICOVP                           DIVISION    REGION
          <lgcl>                             <fctr>    <fctr>
      1:   FALSE Middle Atlantic (Northeast region) Northeast
      2:   FALSE Middle Atlantic (Northeast region) Northeast
      3:   FALSE Middle Atlantic (Northeast region) Northeast
      4:   FALSE Middle Atlantic (Northeast region) Northeast
      5:   FALSE Middle Atlantic (Northeast region) Northeast
     ---                                                     
1735551:   FALSE  West South Central (South Region)     South
1735552:   FALSE  West South Central (South Region)     South
1735553:   FALSE  West South Central (South Region)     South
1735554:    TRUE  West South Central (South Region)     South
1735555:   FALSE  West South Central (South Region)     South
                                                      HIMRKS             JWTRNS
                                                      <fctr>             <char>
      1:      Direct purchase coverage, with premium subsidy Car, truck, or van
      2: Direct purchase coverage, without a premium subsidy               <NA>
      3:      Direct purchase coverage, with premium subsidy Car, truck, or van
      4: Direct purchase coverage, without a premium subsidy Car, truck, or van
      5: Direct purchase coverage, without a premium subsidy Car, truck, or van
     ---                                                                       
1735551:                Categorically ineligible for subsidy Car, truck, or van
1735552: Direct purchase coverage, without a premium subsidy Car, truck, or van
1735553: Direct purchase coverage, without a premium subsidy Car, truck, or van
1735554:                Categorically ineligible for subsidy               <NA>
1735555:                Categorically ineligible for subsidy Car, truck, or van
                                 RELSHIPP  WKWN FHIMRKSP FJWTRNSP FRELSHIPP
                                   <char> <int>   <lgcl>   <lgcl>    <lgcl>
      1:                 Reference person    52     TRUE     TRUE     FALSE
      2: Opposite-sex husband/wife/spouse    NA     TRUE    FALSE     FALSE
      3:       Biological son or daughter    52     TRUE     TRUE     FALSE
      4:       Biological son or daughter    52     TRUE     TRUE     FALSE
      5:       Biological son or daughter    52     TRUE     TRUE     FALSE
     ---                                                                   
1735551:                 Reference person    52    FALSE    FALSE     FALSE
1735552: Opposite-sex husband/wife/spouse    52    FALSE    FALSE     FALSE
1735553:       Biological son or daughter    52    FALSE    FALSE     FALSE
1735554:                 Reference person    NA    FALSE    FALSE     FALSE
1735555: Opposite-sex husband/wife/spouse    37    FALSE    FALSE     FALSE
         FWKWNP  MLPIK  year location age_groups ins_type age_decade avg_income
         <lgcl> <lgcl> <int>   <char>     <char>   <char>      <num>      <num>
      1:   TRUE     NA  2021       ny      18-64   direct         60   109935.7
      2:  FALSE     NA  2021       ny      18-64   direct         40   109935.7
      3:   TRUE     NA  2021       ny      18-64   direct         30   109935.7
      4:   TRUE     NA  2021       ny      18-64   direct         20   109935.7
      5:   TRUE     NA  2021       ny      18-64   direct         20   109935.7
     ---                                                                       
1735551:  FALSE     NA  2022       tx      18-64 employer         50   103775.2
1735552:  FALSE     NA  2022       tx        65+ employer         60   103775.2
1735553:  FALSE     NA  2022       tx      18-64   direct         20   103775.2
1735554:  FALSE     NA  2022       tx        65+ employer         60   103775.2
1735555:  FALSE     NA  2022       tx      18-64 employer         60   103775.2

Feature Rich

Reshaping

# Pivot longer - select key demographics
pums_long <- melt(
  pums, 
  id.vars = c("ST", "year", "SERIALNO"),
  measure.vars = c("AGEP", "PWGTP", "PINCP")
)
pums_long
                  ST  year      SERIALNO variable value
              <char> <int>        <char>   <fctr> <int>
      1: New York/NY  2021 2021HU0896827     AGEP    60
      2: New York/NY  2021 2021HU0896827     AGEP    40
      3: New York/NY  2021 2021HU0896827     AGEP    34
      4: New York/NY  2021 2021HU0896827     AGEP    26
      5: New York/NY  2021 2021HU0896827     AGEP    20
     ---                                               
5206661:    Texas/TX  2022 2022HU0609672    PINCP 27600
5206662:    Texas/TX  2022 2022HU0609672    PINCP 50000
5206663:    Texas/TX  2022 2022HU0609672    PINCP 18000
5206664:    Texas/TX  2022 2022HU0609675    PINCP 33700
5206665:    Texas/TX  2022 2022HU0609675    PINCP 42200
# Pivot wider - average by state/year
pums_summary <- pums[, 
  .(avg_age = mean(AGEP, na.rm = TRUE),
    avg_income = mean(PINCP, na.rm = TRUE)), 
  by = .(ST, year)
]
dcast(pums_summary, ST ~ year, value.var = "avg_age")
Key: <ST>
              ST     2021     2022
          <char>    <num>    <num>
1: California/CA 41.47709 41.54009
2:   New York/NY 43.12366 43.18311
3:      Texas/TX 40.59856 40.82080

Feature Rich

Rolling operations

# Population change over time by state
pums_yearly <- pums[, .(pop = sum(PWGTP)), by = .(ST, year)]
setkey(pums_yearly, ST, year)

# Calculate 2-year rolling average (limited years available)
pums_yearly[, pop_2yr_avg := frollmean(pop, 2), by = ST]
pums_yearly
Key: <ST, year>
              ST  year      pop pop_2yr_avg
          <char> <int>    <int>       <num>
1: California/CA  2021 39237836          NA
2: California/CA  2022 39029342    39133589
3:   New York/NY  2021 19835913          NA
4:   New York/NY  2022 19677151    19756532
5:      Texas/TX  2021 29527941          NA
6:      Texas/TX  2022 30029572    29778756

Feature Rich

Rolling Joins

benefit_thresholds <- data.table(
  age_threshold = c(18, 25, 35, 50, 62, 67),
  benefit_type = c("Youth", "Young Adult", "Adult", "Mid-Career", "Pre-Retirement", "Senior"),
  max_benefit = c(500, 800, 1200, 1500, 2000, 2500)
)
setkey(benefit_thresholds, age_threshold)
benefit_thresholds
Key: <age_threshold>
   age_threshold   benefit_type max_benefit
           <num>         <char>       <num>
1:            18          Youth         500
2:            25    Young Adult         800
3:            35          Adult        1200
4:            50     Mid-Career        1500
5:            62 Pre-Retirement        2000
6:            67         Senior        2500

. . .

# Rolling join to assign benefits based on nearest age threshold
pums[
  benefit_thresholds, 
  benefit_category := benefit_type, 
  on = .(AGEP = age_threshold), 
  roll = -Inf
]
pums[, .(AGEP, benefit_category, ins_type, location)]
          AGEP benefit_category ins_type location
         <int>           <char>   <char>   <char>
      1:    60             <NA>   direct       ny
      2:    40             <NA>   direct       ny
      3:    34             <NA>   direct       ny
      4:    26             <NA>   direct       ny
      5:    20             <NA>   direct       ny
     ---                                         
1735551:    56             <NA> employer       tx
1735552:    67           Senior employer       tx
1735553:    21             <NA>   direct       tx
1735554:    66             <NA> employer       tx
1735555:    64             <NA> employer       tx

roll = "nearest" or roll = +Inf are also possible

Feature Rich

Operators - Core Symbols

Essential data.table operators for efficient data manipulation

# .N - Number of rows in each group
pums[, .N, by = ST]  # Count rows by state
              ST      N
          <char>  <int>
1:   New York/NY 403958
2:      Texas/TX 554365
3: California/CA 777232
# .SD - Subset of Data (all columns except grouping)
pums[, names(.SD) := lapply(.SD, mean, na.rm = TRUE), by = ST, .SDcols = c("AGEP", "PINCP")]
pums[, .(ST, AGEP, PINCP)]
                  ST  AGEP PINCP
              <char> <int> <int>
      1: New York/NY    43 52025
      2: New York/NY    43 52025
      3: New York/NY    43 52025
      4: New York/NY    43 52025
      5: New York/NY    43 52025
     ---                        
1735551:    Texas/TX    40 45756
1735552:    Texas/TX    40 45756
1735553:    Texas/TX    40 45756
1735554:    Texas/TX    40 45756
1735555:    Texas/TX    40 45756
# .BY - List of grouping variables
pums[, .(mean_age = mean(AGEP), state = gsub("/.*$", "", .BY)), by = ST]
              ST mean_age      state
          <char>    <num>     <char>
1:   New York/NY       43   New York
2:      Texas/TX       40      Texas
3: California/CA       41 California
# .I - Row indices 
pums[, .I[which.max(AGEP)], by = ST]  # Index of oldest person per state
              ST     V1
          <char>  <int>
1:   New York/NY      1
2:      Texas/TX 200068
3: California/CA 461514

Feature Rich

Operators - Advanced Features

Specialized operators for complex operations

# .EACHI - For each item in i (useful with joins)
household_summary[pums, on = .(ST, year), mean(AGEP), by = .EACHI]
                  ST  year    V1
              <char> <int> <num>
      1: New York/NY  2021    43
      2: New York/NY  2021    43
      3: New York/NY  2021    43
      4: New York/NY  2021    43
      5: New York/NY  2021    43
     ---                        
1735551:    Texas/TX  2022    40
1735552:    Texas/TX  2022    40
1735553:    Texas/TX  2022    40
1735554:    Texas/TX  2022    40
1735555:    Texas/TX  2022    40
# .GRP - Group counter (1, 2, 3, ...)
pums[, .(grp_num = .GRP, pop = sum(PWGTP)), by = ST]
              ST grp_num      pop
          <char>   <int>    <int>
1:   New York/NY       1 39513064
2:      Texas/TX       2 59557513
3: California/CA       3 78267178
# Multiple .SD operations with .SDcols
pums[, {
    means <- lapply(.SD, mean, na.rm = TRUE)
    medians <- lapply(.SD, median, na.rm = TRUE)
    vars <- names(.SD)
    .(vars, means, medians)
  }, 
  by = ST, 
  .SDcols = c("AGEP", "PINCP", "PWGTP")
]
              ST   vars    means medians
          <char> <char>   <list>  <list>
1:   New York/NY   AGEP       43      43
2:   New York/NY  PINCP    52025   52025
3:   New York/NY  PWGTP 97.81478      73
4:      Texas/TX   AGEP       40      40
5:      Texas/TX  PINCP    45756   45756
6:      Texas/TX  PWGTP 107.4338      76
7: California/CA   AGEP       41      41
8: California/CA  PINCP    54155   54155
9: California/CA  PWGTP 100.6999      75
# Chaining with operators
pums[year == 2022][, .N, by = ST][order(-N)]
              ST      N
          <char>  <int>
1: California/CA 391171
2:      Texas/TX 292919
3:   New York/NY 203891

Feature Rich

Not convinced by the syntax?

library(dtplyr)

pums_dt <- pums |> 
  lazy_dt() |> 
  select(PINCP, age_groups, year) |> 
  group_by(age_groups, year) |> 
  summarise(avg_tot_income = mean(PINCP)) |> 
  collect()  # or as.data.table() will collect it too
pums_dt
# A tibble: 6 × 3
# Groups:   age_groups [3]
  age_groups  year avg_tot_income
  <chr>      <int>          <dbl>
1 18-64       2021         51100.
2 18-64       2022         50939.
3 65+         2021         51131.
4 65+         2022         50953.
5 Under 18    2021         50873.
6 Under 18    2022         50701.
pums |> 
  lazy_dt() |> 
  select(PINCP, age_groups, year) |> 
  group_by(age_groups, year) |> 
  summarise(avg_tot_income = mean(PINCP)) |> 
  show_query()
`_DT2`[, .(PINCP, age_groups, year)][, .(avg_tot_income = mean(PINCP)), 
    keyby = .(age_groups, year)]

Review

  1. Learn the DT[i, j, by] syntax - it’s the foundation
  2. Use keys for fast subsetting and joins
  3. Modify by reference with := for memory efficiency
  4. Chain operations and use operators for readable, efficient code
  5. Check the documentation - excellent vignettes available

Resources:

  • Official vignettes: vignette("datatable-intro")
  • GitHub: https://github.com/Rdatatable/data.table
  • Stack Overflow: [data.table] tag